JP5732771B2 - Video output device, video output system, video output method and program - Google Patents

Description

  The present invention relates to a video output device such as a projector device or a display device, and more specifically, a video output device that acquires content via a network and outputs a video, and a video output system including the video output device and an operation device. The present invention relates to a video output method executed by the video output device and a program for realizing the video output device.

  In recent years, video output devices that output video such as projectors and displays have become widespread, and in government offices, companies, universities, etc., a personal computer (hereinafter referred to as a PC) is connected to the projector or display to project content. However, it is becoming common to hold meetings and lectures. In such a case, the computer and the video output device are connected by an appropriate interface such as a VGA (Video Graphics Array) interface or DVI (Digital Visual Interface), and the screen data from the PC is transferred to the screen. The video is being output. In recent years, in addition to physical interface connections such as VGA and DVI, a technology for outputting a computer screen image to a video output device via a network has been developed.

  In addition, with the recent development of network infrastructure and higher performance of video output devices, the opportunities to use video output devices remotely have increased, and the usage forms of video output devices have diversified and the usage opportunities have increased. Yes. From such a background, from the viewpoint of managing the video output device, there is a demand for more detailed understanding of the usage status of the video output device. For example, it is convenient to be able to track the usage history at a later date as to who has played what type of content, and to charge for the usage status of the video output device. Furthermore, from the viewpoint of using the video output device, there is a demand for reusing content reproduced using the video output device. For example, when conducting a meeting or lecture using a video output device, if you want to add new progress contents to the previous presentation contents later, or change the contents to match the characteristics of the audience and the lecture time, It is convenient if the content reproduced using the video output device can be reused.

  Conventionally, techniques for grasping the total output time of a video output device and information on consumables such as lamps and filters have been developed. For example, Japanese Patent Laid-Open No. 2008-227726 (Patent Document 1) is inputted in a projector capable of mounting lamps of a plurality of types of lamp sizes for the purpose of thorough management during and after lamp replacement. A projector is disclosed that permits resetting of the lamp timer when it is confirmed that the received information is a valid lamp serial code.

  In addition, Japanese Patent Laid-Open No. 2008-224869 (Patent Document 2) discloses that the time value of the lamp timer is set to the nominal life time included in the lamp serial code for the purpose of appropriately managing the lamp replacement time. A projector is disclosed that presents an alarm recommending replacement of a lamp mounted on the projector when a value based on the threshold is reached. Japanese Patent Laid-Open No. 2008-224867 (Patent Document 3) describes the contents of the lamp serial code and the lamp timer for the purpose of appropriately managing the history of the usage time of the replaced lamp. There is disclosed a projector characterized in that a timed value is stored in a memory as log history data of a replaced predetermined lamp.

  However, in the conventional video output device described above, the information that can be acquired as the usage status is only able to grasp only the information related to the usage status of the video output device itself such as the total output time and the usage time of the lamp, It is not possible to grasp the usage situation including the content of the projected video content. Further, the above-described conventional video output device transfers a video generated on a terminal such as a computer to the video output device, and projects the video transferred by the video output device merely as a projection. It does not mean that the contents of the video can be grasped.

  On the other hand, Japanese Unexamined Patent Application Publication No. 2007-295127 (Patent Document 4) is disclosed as a technique for realizing processing according to the content of a video projected by a video output device. Patent Document 4 converts an RGB video signal into still image data such as JPEG for the purpose of controlling the disclosure of a highly confidential document without performing a special operation on the document projected on the projector, and image data. And recognizing an image at a specific position (predetermined position) in the image, extracting metadata, and performing predetermined processing on the image data based on the extracted metadata A conference system is disclosed. However, the technique disclosed in Patent Document 4 does not make it possible to grasp the usage situation including the content of the projected video described above.

  In addition, as a technique for acquiring information regarding the contents of video, there is a technique in which bibliographic information or the like is attached in advance to the video content, and bibliographic information is acquired together with the video content. However, in this case, the work burden of adding bibliographic information to the content in addition to the creation of the video content is imposed on the content creator.

  Furthermore, regarding the reuse of content, it is possible to store the content played back using the video output device in the video format, but enormous amounts of video data will be stored on the server, In addition, the video data is inconvenient when it is changed and reused.

  As described above, the conventional video output device cannot record the detailed usage history of the video output device including the content of the output video, and still includes the content of the output video. It has been desired to develop a technology that makes it possible to grasp a detailed usage history of a video output device.

  The present invention has been made in view of the above-described problems of the prior art, and can grasp the usage status of the video output device including the contents of the output content to be output. As a result, the usage history can be tracked later. It is an object of the present invention to provide a video output device that can be reused, a video output method that is executed by the video output device, and a program for realizing the video output device.

  As a result of intensive studies, the present inventor has managed the content separately into metadata describing the structure of the content and substantive data as content parts, and in accordance with the metadata on the video output device side By using a content playback method that generates output content that is actually output and projects the generated output content, the usage status of the video output device including the content of the output content is grasped in detail from the metadata. In addition, the present inventors have found the advantage that this metadata can be reused when it is desired to make a slight change or modification to the output contents and project it again, and the present invention has been achieved.

  That is, in order to solve the above problems, the present invention provides a video output device connected to a network described below, and a video output system including the video output device and an operation device. The video output device of the present invention receives metadata defining the output content to be output from the terminal device, analyzes this, and identifies the sub-contents constituting the output content and the layout of the sub-contents. The video output device acquires the identified sub-contents via the network, combines the acquired sub-contents according to the layout in the metadata, generates target output content, and outputs the video.

  According to the above configuration, the content of the output content is defined by the metadata. Therefore, the video output device that receives this metadata can grasp the usage status including the content of the output content. Also, by storing the metadata in the terminal device, projector device or other computer device, the output content can be confirmed at a later date, or when it is necessary to make a slight change or modification to the output content and project it again. You can also reuse the stored metadata. Since the output content to be output is managed separately from the content entity and the metadata, and because the metadata defines the content of the output content, the output can be output only by editing the metadata. The content can be changed, and the burden on the user when re-editing the content of the output content can be reduced.

  Furthermore, in the present invention, the video output device stores the metadata itself related to the output content output as video, or data obtained by appropriately adding or deleting information to the analysis result of the metadata as the usage history of the video output device. Can be stored in the device. By accumulating metadata as a usage history, it becomes possible to track usage status and grasp usage statistics at a later date.

  Furthermore, in the present invention, the video output device identifies the user of the video output device, and the conditions for generating the output content and other conditions for storing the usage history information correspond to the identified user. Can be changed. With the above configuration, the output content generation rules to be applied to each specified user are changed, output contents that differ in appearance and content depending on the user, and the management destination of the usage history is changed It becomes possible.

  In the present invention, the video output device can synchronize data by transmitting the usage history stored in the storage device included in the video output device to an external server device that manages the usage history of the video output device. According to the above configuration, since it is not necessary to accumulate the use history for a long time in the video output device itself, the storage capacity required for the auxiliary storage device included in the video output device can be suitably reduced, and the cost can be reduced. It is also advantageous from the viewpoint.

  The present invention further includes an identification value for identifying the video output device and an identification value for identifying the synchronization-destination history management server device for a remote communication management server that manages remote communication during data synchronization. By transmitting the synchronization information, the remote communication management server can manage the synchronization of the video output device. Further, in the present invention, when the usage history corresponding to the search query is not found even after searching the usage history stored in the storage device, the search query is passed to the remote communication management server and the history management server device is extended. The search result can be inquired.

  With the above configuration, the location of usage history is centrally managed by the telecommunications management server, so even when there are multiple history management servers, it is possible to search for usage history across history management server devices. It is advantageous from the viewpoint of efficiency, and since it is not necessary to manage the synchronization destination on the video output device side, the storage capacity required for the auxiliary storage device of the video output device can be suitably reduced.

  Furthermore, in the present invention, the video output device detects an operation state including a power supply state and a video output state of the video output device, and transmits the detected operation state to a remote communication management server that manages remote communication. The remote communication management server can manage the operation state of the video output device. With the above configuration, since the operation state of the video output device, such as offline, online, projecting, and playing, is centrally managed by the remote communication management server, the video output device can be used for a terminal having the video output device as a communication partner. It will be possible to inform the operating state of.

  In the present invention, the video output device can transfer metadata associated with another video output device to the other video output device. According to the above configuration, a plurality of video output devices can be linked to output output contents individually. This is useful, for example, when conferencing remotely while sharing materials. Also, the usage status at that time can be grasped on the video output device side which is the center, and can be accumulated as a usage history.

  Further, according to the present invention, the video output device can be configured to include a conversion module for using the sub content corresponding to the format of the sub content, and manages and requires the usable conversion module. When the conversion module is not available, a procedure for making the required conversion module available can be performed by communicating with the server device that manages the use of the conversion module.

  According to the above configuration, even when a new format appears due to technological progress, or when it is necessary to use a format that does not have a license or a format that has not been downloaded, the user can flexibly as necessary. It becomes possible to cope with. In addition, since the conversion module can be acquired via the network as needed, the capacity of the storage area required to hold the conversion module program can be reduced, which is advantageous from the viewpoint of cost.

  Further, according to the present invention, the video output apparatus can acquire the access-controlled sub-content using the authentication information held corresponding to the user when acquiring the access-controlled sub-content. According to the above configuration, even a content with security protection can be output as a video by a user having an appropriate authority, and security at that time is maintained.

  In the present invention, the video output device can synthesize the output content by allocating sub-contents provided as a document, text, graphic data, moving image data, or audio data according to the layout identified from the metadata. Further, the metadata defines the storage destination address of the sub-content such as URI, the sub-content allocation method (mode), the sub-content allocation position (coordinates), and the sub-content size (magnification) in the output content. Layout information.

  Furthermore, according to the present invention, it is possible to provide a video output method executed by the video output device described above and a program for realizing the video output device described above.

1 is a schematic diagram of a video output system according to a first embodiment. 1 is a block diagram showing a schematic configuration of a video output system according to a first embodiment. The figure which illustrates the operation screen of the projector apparatus displayed on the display screen of the operation terminal of 1st Embodiment. The figure which shows the data structure of a series of metadata which the projector apparatus of 1st Embodiment receives. The figure which shows the data structure of an output content production | generation rule in 1st Embodiment. The figure which shows the projection screen of the output content projected by the video display unit of 1st Embodiment. The figure which shows the data structure of the accumulation | storage content management table accumulate | stored in the content storage part of 1st Embodiment. 6 is a flowchart showing an operation of a video output method executed by the projector device of the first embodiment. Schematic of the video output system of 2nd Embodiment. The hardware block diagram of the remote communication terminal and server of 2nd Embodiment. The block diagram which shows schematic structure of the video output system of 2nd Embodiment. The block diagram which shows schematic structure of the projector apparatus in embodiment in which a remote communication terminal is comprised integrally. The figure which shows the data structure of the table which the remote communication management server of 2nd Embodiment manages. The sequence diagram which showed the process of the preparation stage which starts remote communication between the some remote communication terminal of 2nd Embodiment. The sequence diagram which showed the process performed when the state of the projector apparatus of 2nd Embodiment changed. The figure which shows the projection screen of the output content projected separately from two projector apparatuses by the metadata transmission which instruct | indicates the icon display which shows that it is "projecting" of 2nd Embodiment. Schematic of the video output system of 3rd Embodiment. The block diagram which shows schematic structure of the video output system of 3rd Embodiment. The figure which shows the data structure of the data managed for every user in 3rd Embodiment. The figure which shows the data structure of a series of metadata which the projector apparatus of 3rd Embodiment receives. The figure which shows the projection screen of the output content projected separately from two projector apparatuses in 3rd Embodiment. The flowchart (1/2) which shows operation | movement of the image | video output method which the projector apparatus of 3rd Embodiment performs. The flowchart (2/2) which shows operation | movement of the video output method which the projector apparatus of 3rd Embodiment performs. The block diagram which shows schematic structure about the function relevant to utilization log information in the video output system of 3rd Embodiment. The flowchart which shows the synchronous process performed between the projector apparatus and log | history management server of 3rd Embodiment. The figure which shows the data structure of the accumulation | storage content management table accumulate | stored in the content storage part of 3rd Embodiment. The figure which shows the outline of the video output system of 4th Embodiment. The functional block diagram of each terminal, apparatus, and server which comprise the video output system of 4th Embodiment. The flowchart which shows the synchronous process performed between the projector apparatus of 4th Embodiment, a log | history management server, and a remote communication management server. The figure which shows the data structure of the accumulation | storage content management table accumulate | stored in the content storage part of 3rd Embodiment. The figure which shows the data structure of the metadata log | history management table which comprises metadata log | history management DB. The flowchart which shows the search process performed between the projector apparatus of 4th Embodiment, a remote communication management server, and a log | history management server. The figure which illustrates the operation screen for reusing the content displayed on the display screen of the operation terminal of 4th Embodiment.

  Hereinafter, although embodiment of this invention is described, embodiment of this invention is not limited to the following embodiment. In the following embodiments, as an example of a video output device and a video output system, a projector device that receives data from an operation terminal and outputs video and a video output device that includes the projector device will be described. To do.

[First Embodiment]
FIG. 1 is a diagram schematically illustrating a video output system 100 according to the first embodiment. A video output system 100 shown in FIG. 1 includes an operation terminal 120, projector devices 130a and 130b, and a content database (hereinafter referred to as DB) 142 that are connected to each other via a network 110. Management server 140. The network 110 uses, for example, a LAN (Local Area Network) based on a transaction protocol such as Ethernet (registered trademark) or TCP / IP (Transmission Control Protocol / Internet Protocol), a VPN (Virtual Private Network), or a dedicated line. It can be configured as a WAN (Wide Area Network) or the like to be connected. However, the configuration of the network 110 is not particularly limited, and may include the Internet connected via a router (not shown), and may be configured as a wired or wireless network, or a mixed network thereof. Needless to say, you can.

  The operation terminal 120 is a terminal device that outputs images to the projector devices 130a and 130b via the network 110. In FIG. 1, a notebook personal computer is illustrated, but other than that, a netbook, a desktop type is used. Personal computers, various computer devices such as workstations, PDA (Personal Digital Assistant), and various portable terminals such as cellular phones. In the video output system 100 of the present embodiment, the operation terminal 120 transmits not the content to be output (hereinafter referred to as output content) itself but metadata describing the configuration of the output content. The projector device 130 is made to output the content video.

  The projector device 130 receives and analyzes metadata from the operation terminal 120 and acquires necessary content via the network 110 according to the description of the metadata. In the embodiment shown in FIG. 1, the projector device 130 accesses the content management server 140 that stores and manages content to acquire necessary content. In the example illustrated in FIG. 1, a microphone 122 and a web camera 124 are connected to the operation terminal 120, and the projector device 130 uses audio data and video data streamed from the microphone 122 and the web camera 124, respectively, as contents. It can also be acquired. Further, in the example shown in FIG. 1, pointer information from the mouse 126 provided in the operation terminal 120 can be acquired as content, and in addition, moving image data generated by capturing a desktop image is acquired as content. You can also. In the video output system 100 of the present embodiment, the projector device 130 obtains one or more necessary contents, and then outputs the video by combining the output contents in accordance with the description of the metadata and projecting it on the screen. In the present embodiment, video output is performed using metadata in this way.

  In the present embodiment, metadata transmitted and received between the operation terminal 120 and the projector device 130 includes an address indicating a storage position of content (hereinafter, also referred to as sub-content) necessary as a part constituting the output content. And a layout for defining the screen layout of the sub-contents, the layout position and the layout size. A URI (Uniform Resource Locator) such as a URL (Uniform Resource Locator) or a URN (Uniform Resource Name) can be used as the address indicating the storage location of the sub-content. The transmission / reception of metadata is not necessarily performed via the above-described network such as a LAN, and the operation terminal 120 and the projector device 130 can also be performed via another interface connection such as a USB.

  The sub-content that can be used to configure the output content is not particularly limited, and examples include various types of documents, text, still images, moving images, audio, graphics (eg, pointers), and the like. be able to. The metadata described above can include information identifying such sub-content types and other information. Sub-contents of the above document type are not particularly limited, but include documents created by various office suites, presentations, spreadsheets, drawings by graphic software, document formats such as PDF (Portable Document Format), etc. There are various file formats.

  The moving image type sub-contents are not particularly limited, but include MPEG (Moving Picture Experts Group) -1, MPEG-2, H.264, and H.264. Video data in various file formats such as AVI (Audio Video Interleave), MOV, Flash Video (Flash (registered trademark) Video) using various video codecs and audio codecs such as H.264 / MPEG-4AVC (Advanced Video Coding) Can be mentioned. There are no particular limitations on the audio type sub-contents, but there are various types such as WAV (RIFF Waveform Audio Format), MP3 (MPEG-1 Audio Layer-3), and WMA (Windows (registered trademark) Media Audio). List file formats.

  Examples of the sub-content of the image type include image data of various file formats such as BMP, GIF (Graphics Interchange Format), JPEG (Joint Photographic Experts Group), and JPEG2000. The text type sub-content mainly means plain text in this embodiment, but may include multi-style text including format information, hypertext, and the like. It should be noted that there is not always a clear standard for classifying the text type or the document type. In the present embodiment, plain text is classified as a text type, and multi-style text and hypertext are classified as a document type. However, it may be appropriately determined according to a specific application or specification. As the graphic type sub-content, a pointer can be typically employed. However, the graphic type sub-content is not particularly limited, and various graphic objects such as a marker for highlighting a desired area can be adopted. In the embodiment described below, description will be made using a mouse pointer.

  The content management server 140 shown in FIG. 1 manages the content DB 142 and distributes necessary content in response to a content acquisition request from an external device. Needless to say, the content management server 140 may be a web server or a file server, and necessary sub-contents may be distributed among a plurality of servers.

  Hereinafter, the operation of the video output system 100 of the present embodiment will be described in detail. FIG. 2 is a block diagram illustrating a schematic configuration of the video output system according to the first embodiment. Projector device 130 shown in FIG. 2 includes control unit 210 and video display unit 240. The control unit 210 receives metadata from a network interface (hereinafter referred to as a network I / F) 220 and an external operation terminal 120 connected via the network I / F 220, and receives the metadata. A metadata reception / analysis unit 222 to be analyzed, a content acquisition unit 224, and an output content generation unit 226 are included. The content acquisition unit 224 acquires necessary sub-contents from the content management server 140 or the like via the network I / F 220. The output content generation unit 226 combines the acquired one or more sub-contents according to the received metadata to generate output content.

  On the other hand, the operation terminal 120 includes a content display operation unit 202. The content display operation unit 202 provides an operation environment for arranging sub-contents to be output by being incorporated into output content, generates metadata in response to a user command, and generates metadata of the projector device 130 The data is transmitted to the reception / analysis unit 222. Although not particularly limited, in the embodiment to be described, the content display operation unit 202 and the metadata reception / analysis unit 222 have protocols such as SIP (Session Initiation Protocol) and XMPP (eXtensible Messaging and Presence Protocol). Implemented as an embedded dedicated application module, metadata is transmitted and received by peer-to-peer communication.

  However, the specific implementation is not particularly limited as long as appropriate metadata can be created and appropriately transmitted / received. In other embodiments, the metadata reception / analysis unit 222 is implemented by incorporating a web server function. In addition, the content display operation unit 202 can be implemented by a web browser, and metadata can be transmitted and received between the operation terminal 120 and the projector device 130 using the HTTP protocol. The metadata receiving / analyzing unit 222 constitutes a receiving unit and an analyzing unit of the present embodiment.

  For example, when the operator activates the content display operation unit 202 on the operation terminal 120, an operation screen for operating the projector device 130 is displayed on the display. FIG. 3 illustrates an operation screen of the projector apparatus displayed on the display screen of the operation terminal 120 of the present embodiment. The operation screen 300 shown in FIG. 3 is a pull-down menu 302 for selecting a desired screen layout setting from among pre-registered options, two buttons 304 and 306, and an entire display area for the entire output content. The region 310 is included.

  The entire area 310 is divided into two left and right screen areas 312 and 314 in the example shown in FIG. In the operation screen shown in FIG. 3, for example, a dialog box is used for each of the divided screen areas 312 and 314, or a sub-content or a sub-content shortcut is dragged and dropped to set the sub-content URL. Then, corresponding metadata is generated and transmitted to the projector device 130.

  FIG. 4 is a diagram illustrating a data structure of a series of metadata 400 received by the projector device 130. Each metadata 400 shown in FIG. 4 includes a video output device ID 400a, a sub-content type 400b, a sub-content URI 400c, a mode 400d for defining a screen division of the sub-content, a coordinate 400e for arranging the sub-content, It includes a magnification 400f that defines the size of the sub-content and a metadata reception time 400g. The video output device ID uniquely identifies the projector device 130. For example, a SIP ID or JID specified by a technology such as SIP or XMPP can be used.

  The mode 400d, the coordinates 400e, and the magnification 400f define the layout in this embodiment. The layout defining method is not particularly limited as long as the arrangement position and display size of the sub-content can be defined. For example, it may be specified by any other expression such as defining both the arrangement position and the display size by the coordinates of the start point and the end point.

  As an example of generated and transmitted metadata, for example, when the URL (http: //www.xx.yy/1) of a document type sub-content is set in the divided image area 312 using the operation screen 300, FIG. Metadata as shown in the first row is generated and transmitted to the projector device (projector1@xxxx.co.jp) 130. The layout defined in the metadata can be configured to be determined according to the screen allocation setting selected from the pull-down menu 302 of FIG. 3, for example. In the example shown in FIG. 4, the document type sub-content is first displayed in the first area in the “single” mode in which the output content is generated without dividing the screen by the first-stage metadata, and then the second-stage metadata is displayed. In the “dual” mode in which the output metadata is generated by dividing the screen into two by the metadata of the eyes, the text type sub-content is displayed in the second area generated by the division.

  Referring again to FIG. 3, a camera display area 316 for displaying the camera image of the web camera 124 is configured in the lower left part of the screen of the entire area 310. A button 304 is a GUI (Graphical User Interface) component for designating that the video of the web camera 124 provided in the operation terminal 120 is included in the output content as the sub content. When the button 304 is clicked, the distribution of the camera video is activated, and for example, the camera video as shown in the fifth row of FIG. 4 so as to arrange the camera display area 316 at a preset screen allocation position / magnification. The metadata describing the URI assigned to the distribution function is transmitted. As a result, in the “over” mode, the camera video as the moving image type sub-content is displayed in an overlapped manner on the designated screen area in the entire area.

  Similarly, the button 306 is a GUI component for designating that the sound of the microphone 122 provided in the operation terminal 120 is included in the output content as the sub content. When the button 306 is clicked, the audio distribution is activated. Then, for example, metadata describing the URI assigned to the voice distribution function as shown in the fourth row of FIG. 4 is transmitted. Note that functional units for performing audio distribution by the microphone 122 and video distribution by the web camera 124 are shown as a microphone audio distribution unit 204 and a camera video distribution unit 206 in FIG.

  Furthermore, a pointer graphic 318 is shown in the entire area 310 shown in FIG. For example, when the pointer graphic 318 is dragged and moved, metadata describing the coordinates of the pointer as shown in the third row of FIG. 4 is transmitted so as to move the pointer graphic displayed on the output content. The As a result, in the “over” mode, a pointer graphic that is a graphic type sub-content is superimposed and displayed at a designated coordinate position in the entire area.

  In addition, the metadata transmitted and received in the present embodiment is not limited to the metadata for controlling the content of the output content as described above, but defines a breakpoint for the end of the output content, or a summary of a plurality of output content. Command types that command output can be included. Details of content end and summary output will be described later. Further, when the arrangement coordinates, size, and magnification of each area 312, 314, 316 are changed on the operation screen 300, metadata in which coordinates 400e and magnification 400f are set correspondingly is transmitted. Further, in the case of document-type content composed of a plurality of pages, when page turning is instructed on the operation screen 300, metadata for instructing page turning is transmitted.

  Referring again to FIG. 2, when receiving the metadata from the content display operation unit 202, the metadata reception / analysis unit 222 analyzes the received metadata and passes the analysis result to the content acquisition unit 224. The content acquisition unit 224 appropriately accesses the URI of the sub content via the network I / F 220 according to the received interpretation result of the metadata, and acquires the sub content specified in the metadata. For example, the URI of the sub content in the metadata can indicate the content stored in the content DB 142 of the content management server 140, the camera video distribution unit 206 or the microphone audio distribution unit 204 of the operation terminal 120.

  The content management server 140 shown in FIG. 2 includes a content distribution unit 208. The content distribution unit 208 processes a content acquisition request from an external client and executes a distribution process of content stored in the content DB 142. Although not particularly limited, in the present embodiment, the content distribution unit 208 is implemented by incorporating a web server function, the content acquisition unit 224 is implemented as an HTTP client, and the subordinate between the content management server 140 and the projector device 130 is implemented. A description will be given assuming that transmission / reception of contents is performed using the HTTP protocol. However, the sub-content acquisition process is not limited to HTTP, and an existing data transfer protocol such as a file sharing protocol or a file transfer protocol may be adopted.

  When the content acquisition unit 224 acquires the necessary sub-contents, the content acquisition unit 224 passes the metadata analysis result to the output content generation unit 226 together with the acquired sub-contents. In the case where the content acquisition unit 224 does not require acquisition of the content itself, such as metadata of pointer-type sub-contents or metadata instructing to change the size or arrangement of the already specified sub-contents, the content acquisition unit 224 The analysis result is passed to the output content generation unit 226 as it is. Note that the content acquisition unit 224 constitutes acquisition means of the present embodiment.

  More specifically, the output content generation unit 226 synthesizes the conversion module 228 that converts sub-contents of various formats into a format that can be output, and the content synthesis that generates the output content by synthesizing the converted sub-content data. Part 230. Note that the output content generation unit 226 constitutes a generation unit of the present embodiment. The acquired sub-content is transferred to an appropriate conversion module corresponding to the format, subjected to data conversion, and then transferred to the content composition unit 230. The content synthesis unit 230 determines the final sub-content allocation position and allocation size using the layout information included in the passed analysis result, arranges the sub-content in the output content screen, and outputs the output content image. Generate data. The final allocation position and allocation size of the sub-content may be determined as defined in the metadata, but can be determined by applying a rule as shown in FIG.

  When the sub content is real-time data such as camera video or microphone sound, the sub content data is sequentially acquired and reflected in the output content. Further, when metadata is sequentially transmitted from the operation terminal 120, new sub-contents are appropriately acquired correspondingly, and the contents of the output content are updated.

  FIG. 5 illustrates the data structure of the output content generation rule. The output content generation rule 410 shown in FIG. 5 is a rule for supplementing, for example, when the layout or the like is not sufficiently defined in the metadata. The output content generation rule 410 includes a sub-content type 410a to be applied, a mode 410b set for the sub-content to be applied, and coordinates 410c set for the sub-content to be applied. In the embodiment to be described, the output content generation rule is used as a supplement to the layout information that is not defined in the metadata. However, it may include a compulsory rule that rewrites the layout information for a predetermined type. It may also include a rule for switching modes depending on the file type of the document.

  Refer to FIG. 2 again. When the image data of the output content is generated, the output content generation unit 226 sends the image data to the video display unit. The video display unit 240 converts the image data of the output content sent from the control unit 210 into a video signal, and projects it onto the screen S. More specifically, the video display unit 240 includes a graphic controller 242, a VRAM (Video Random Access Memory) 244 that holds screen data, a DAC (Digital to Analogue Converter) 246 that converts digital data into an analog video signal, And a video display device 248 for displaying a video signal converted from the image data. Note that the video display unit 240 constitutes output means of the present embodiment.

  FIG. 6 is a diagram illustrating a projection screen of output content generated by the output content generation unit 226 of the present embodiment and projected by the video display unit 240. The projection screen 320 shown in FIG. 6 is superimposed on the projection screen area 322 where the document type sub-content is displayed, the projection screen area 324 where the text-type sub-content is displayed, and the moving picture type. And a projection screen area 326 in which sub-contents are displayed. As described above, according to the video output system 100 of the present embodiment, by transmitting metadata from the operation terminal 120 to the projector device 130, necessary sub-contents are acquired on the projector device 130 side, and these are synthesized. Composite content will be output.

  Since the metadata used in the present embodiment designates what sub-contents are to be output, the projector device 130 can easily receive the detailed usage status of the projector device 130 by receiving this metadata. Can be grasped. Referring to FIG. 2 again, the control unit 210 of the projector device 130 according to the present embodiment may further include a history recording unit 232, a metadata storage unit 234 that stores metadata, and a content storage unit 236. The content storage unit 236 stores sub-contents, output contents, or data related to these contents.

  The history recording unit 232 receives the metadata received by the metadata reception / analysis unit 222 and stores the metadata or information included in the metadata in the metadata storage unit 234 as usage history information. For example, a series of metadata as shown in FIG. 4 is accumulated in the metadata storage unit 234 in response to the reception of the metadata. The history recording unit 232 also receives the sub-content data acquired by the content acquisition unit 224 and the moving image data of the output content generated by the output content generation unit 226 and stores them in the content storage unit 236. Further, the history recording unit 232 stores an accumulated content management table that associates the stored sub-contents and output content in the content storage unit 236. The metadata storage unit 234 and the content storage unit 236 can be provided by an auxiliary storage area provided by a flash memory or a hard disk drive provided in the projector device 130. The history recording unit 232 constitutes a history recording unit of the present embodiment.

  The moving image data of the output content stored in the content storage unit 236 is not particularly limited, but flash video such as AVI, FI, and SWF using various moving images and audio codecs (Flash (registered trademark) Video). The moving image data of the various file formats described above can be used. From the viewpoint of reducing the capacity and cost of the auxiliary storage device provided in the projector device 130, it may be stored as moving image data that represents video in a higher-order data format such as flash video (Flash (registered trademark) Video). preferable. Since the output content itself can be reconstructed from metadata and existing sub-contents, and the usage status can be grasped by storing these data, the video data of the output content is not necessarily stored as usage history information. I don't need it. Whether or not to store the moving image data of the output content can be set as an environment setting, for example. Since it is not necessary to store the output content as usage history information, it is possible to accumulate a usage history with a sufficient amount of information by holding a minimum amount of information.

  FIG. 7 shows the data structure of the stored content management table stored in the content storage unit of this embodiment. The stored content management table 420 shown in FIG. 7 includes a video output device ID 420a, an output content ID 420b numbered for each output content, a sub-content ID 420c numbered for each acquired sub-content, and a file name of the sub-content. 420d, output content file name 420e, and update time 420f. Note that the information held in the stored content management table 420 is not limited to the example, and may include bibliographic information held according to the file attribute and format of each sub-content.

  The output content corresponds to the start or end of the projector device 130 in response to activation or shutdown of the projector device 130, an instruction or time designation from the operator using the operation panel or operation terminal 120 provided in the projector device 130, or other predetermined conditions. A point is defined. For example, in response to receiving the first metadata from a state in which the content is not generated, recording of the output content is started, and after the content of the output content is updated by receiving some metadata, the projector device 130 In response to receiving a shutdown or video output termination command from the operator, the recording of the output content is terminated and stored as one moving image file. Thereby, for example, a history of explanation using a series of materials in a video conference or the like is accumulated as moving image data of one output content.

  Further, the record with the output content ID “summary01” in FIG. 7 indicates that summary output is instructed, and a series of output contents are collected and stored as one moving image data. The summary output can be used when, for example, each presentation in a video conference or the like is stored as each output content, and a summary of the entire conference is stored as summary content. Operation using the operation panel of the projector device 130 or the operation terminal 120 can be used. Is output in response to a command from the user. In the following description, it is assumed that the above-described content end and summary output commands are transmitted from the operation terminal 120 by metadata.

  Hereinafter, the operation of the video output process executed by the video output system 100 of the first embodiment will be described with reference to a flowchart. FIG. 8 is a flowchart showing the operation of the video output method executed by the projector device of this embodiment. The method shown in FIG. 8 is started from step S100 in response to the start-up of the projector device 130, for example. In step S101, the metadata reception / analysis unit 222 loops the process in step S101 and waits for the metadata until the metadata is sent (during NO). If the metadata is sent in step S101 (YES), the process proceeds to step S102, and the metadata receiving / analyzing unit 222 receives the metadata. In step S103, the history recording unit 232 stores the metadata received by the metadata reception / analysis unit 222 in the metadata storage unit 234 as usage history information.

  In step S104, the metadata reception / analysis unit 222 analyzes the received metadata and obtains an analysis result in a data format that can be interpreted by the content acquisition unit 224 and the output content generation unit 226. In step S105, the process branches depending on the control event depending on the content type and mode specified in the metadata. If the “command” type is specified in the metadata and the “summary output” mode is specified (summary output), the process branches to step S118 in step S105. If the “command” type is specified in the metadata and the “content end” mode is specified (content end), the process branches to step S115 in step S105. On the other hand, if a normal type other than the command type is specified in the metadata (normal), the process branches to step S106 in step S105. Here, the normal type is a type other than the command type, such as document, text, moving image, audio, and pointer, and relates to the content of the output content.

  In step S106, the content acquisition unit 224 determines whether or not content acquisition is necessary. Here, when the metadata specifies the pointer type, or when the allocation position or allocation size of the already-described sub-content is specified, it is determined that content acquisition is unnecessary. If it is determined in step S106 that content acquisition is necessary (YES), the process proceeds to step S107. In step S107, the content acquisition unit 224 acquires sub-contents that are parts of the output content based on the URI described in the metadata. Alternatively, when the sub content is in a stream format generated in real time, the sub content acquisition process is started.

  In step S108, the history recording unit 232 accumulates the acquired sub content, or starts accumulating the sub content for which the acquisition process has been started. In step S109, the output content generation unit 226 applies the output content generation rule 410, and determines the final allocation position and allocation size. If it is determined in step S106 that content acquisition is unnecessary (NO), the process proceeds directly to step S109.

  In step S110, the output content generation unit 226 confirms the generation state of the output content and determines whether to start generating the output content or to update the output content. Here, for example, when the first metadata is received in a state where the content is not generated, such as immediately after activation or immediately after the content end command, it is determined that content generation is to be started. If metadata is received while content is being generated, it is determined that the content is to be updated.

  If it is determined in step S110 that generation of output content is to be started (start), the process proceeds to step S111. In step S111, the output content generation unit 226 starts generating the output content under the conditions determined by applying the metadata and the output content generation rule. In step S112, the history recording unit 232 starts recording the generated output content, and in step S113, the output content generation unit 226 transmits the image data of the output content to the video display unit 240, and the generated output content. Starts output. Subsequently, the process loops to step S101 and waits for the next metadata.

  On the other hand, if it is determined in step S110 that the output content is to be updated (update), the process proceeds to step S114. In step S114, the output content generation unit 226 updates the output content to the latest state under conditions determined by applying the metadata and the output content generation rule. Subsequently, the process loops to step S101 and waits for the next metadata.

  Returning to step S105 again, if the “command” type is specified and the “content end” mode is specified (content end), the process branches to step S115. In step S115, the output content generation unit 226 ends the generation of the output content, and shifts to a content non-generation state. In step S116, the history recording unit 232 finishes recording the output content and the appropriate sub content (when the sub content is in a stream format generated in real time), and in step S117, the video display unit 240 outputs the output content. Exit. Subsequently, the process loops to step S101 and waits for the next metadata.

  If the “command” type is specified and the “summary output” mode is specified (summary output), the process branches to step S118. In step S118, the history recording unit 232 reads output content that has not been output in summary, and in step S119, combines the read output content to create summary content. Subsequently, the process loops to step S101 and waits for the next metadata.

  The control unit described above includes a central processing unit (CPU), a ROM (Read Only Memory) that stores a control program, a RAM (Random Access Memory) that provides an execution storage space that allows the CPU to perform program processing, The projector device 130 includes an NV-RAM, a network interface card (NIC), and the like. The projector device 130 reads a program stored in the ROM or the NV-RAM and develops the program in the memory area of the RAM, thereby controlling the CPU. Each functional unit and each process described above are realized.

  According to the video output system 100 of the above-described embodiment, the content of the output content is defined by the metadata. Therefore, the projector device 130 that receives the metadata grasps the detailed usage state including the content of the output content. It becomes possible to do. In addition, by accumulating this metadata as usage history information, it becomes possible to track the usage history at a later date. Further, since it becomes possible to grasp the detailed usage status, it is possible to charge according to the usage status. For example, it is possible to charge according to the data capacity of the sub-contents constituting the output content, and to change the unit charge for each sub-content type at that time.

  In the embodiment described above, the metadata has been described as being generated by a real-time operation using the operation screen 300 as illustrated in FIG. 3 and transmitted from the operation terminal 120 to the projector device 130. However, a method for generating and transmitting metadata from the operation terminal 120 is not particularly limited. In another embodiment, for example, a series of metadata may be prepared in advance, and the metadata may be sequentially transmitted in response to an operation event such as a mouse click or a keyboard operation. In still another embodiment, a series of metadata may be prepared together with a time table in advance, and the metadata may be transmitted to the projector device 130 in a lump, and the projector device 130 side sequentially processes along the time table.

  Also, according to the video output system 100 of the present embodiment, the output content to be output is managed separately as the content entity and the metadata, and the metadata defines the content of the output content. Therefore, this series of metadata sets can be reused when it is desired to play back content with similar contents at a later date. In this case, in the embodiment in which the metadata prepared in advance according to the operation event as described above is transmitted, or in the embodiment using the metadata timetable, the output content using the re-edited metadata set May be reproduced.

  Furthermore, according to the video output system 100 of the present embodiment, since the content of the output content can be changed only by editing the metadata, for example, a new progress content can be added to the previous presentation content at a later date, It becomes easy to change the contents to match the characteristics of the audience and the lecture time, and the burden on the user at that time can be reduced. Furthermore, when distributing the output content, as long as the actual data of the content can be acquired at the distribution destination, it is not necessary to distribute the actual data, so the amount of data to be sent can be reduced.

[Second Embodiment]
The video output system according to the second embodiment will be described below. Note that the video output system of the second embodiment described below includes a remote communication conference system that uses a conference-specific terminal. In addition, since 2nd Embodiment is provided with the structure similar to 1st Embodiment, it refers to the same function means using the same number, and demonstrates below centering on difference.

  FIG. 9 is a diagram schematically illustrating the video output system 100 according to the second embodiment. The video output system 100 shown in FIG. 9 includes a remote communication management server 160, a relay server 162, and a program providing server 164 in addition to the operation terminal 120, the projector device 130, and the content management server 140 shown in the first embodiment. The remote communication terminal 170 configured as a conference-dedicated device and a display 172 connected to the remote communication terminal 170 are included.

  Since the remote communication terminal 170 performs remote communication with other remote communication terminals 170 and the like, the remote communication terminal 170 transmits and receives video data and / or audio data. In the present embodiment, the case where the video data is a moving image will be described. However, the video data may be a still image or both a moving image and a still image may be included. Further, in the present embodiment, the remote communication terminal 170 also functions as a terminal device that causes the projector device 130 to output an image via the network 110, and, like the operation terminal of the first embodiment, an output to be output. By transmitting metadata describing the configuration of the content, the projector device 130 can output the video of the content.

  The relay server 162 relays video data and audio data between the plurality of remote communication terminals 170. The remote communication management server 160 manages the remote communication terminal 170 and the relay server 162 in an integrated manner. The program providing server 164 has a remote communication terminal program for realizing various functions in the remote communication terminal 170, a relay server program for realizing various functions in the relay server 162, and various functions in the remote communication management server 160. An HDD (not shown) storing a remote communication management program to be realized is provided, and each program can be distributed to each of the remote communication terminal 170, the relay server 162, and the remote communication management server 160. it can.

  FIG. 9 shows a detailed configuration of the network 110. The network 110 includes an Internet 116, a LAN 112 and a dedicated line 114 provided in two areas A and B connected to the Internet 116, respectively. Consists of including. A plurality of routers 154a, 154b, 154c, 154d, 154e, and 154f shown in FIG. 9 select an optimum route for video data and audio data.

  The remote communication terminals 170a and 170b, the projector device 130, the relay server 162a and the router 154a are communicably connected via a LAN 112a. The remote communication terminals 170c and 170d, the operation terminal 120, the relay server 162b and the router 154b are connected via the LAN 112b. It is connected so that it can communicate. The LAN 112a and the LAN 112b are communicably connected by a dedicated line 114a including a router 154c, and are constructed in a predetermined area A. On the other hand, the remote communication terminals 170e and 170f, the relay server 162c and the router 154d are communicably connected via the LAN 112c, and the remote communication terminals 170g and 170h, the relay server 162d and the router 154e are communicably connected via the LAN 112d. The LAN 112c and the LAN 112d are communicably connected by a dedicated line 114b including the router 154f, and are constructed in a predetermined area B. Area A and area B are communicably connected via the Internet 116 from routers 154c and 154f, respectively. The content management server 140, the remote communication management server 160, and the program providing server 164 are communicably connected to the remote communication terminal 170 and the relay server 162 via the Internet 116. Each server 140, 160, 164 may be installed in the region A or the region B, or may be installed in a region other than these. Each terminal 120, 170, each server 160, 162, 164, each router 154, and projector device 130 is assigned an IPv4 or IPv6 IP address.

  Hereinafter, the hardware configuration of the remote communication terminal and each server in the video output system of the second embodiment will be described. In the present embodiment, when a delay occurs in the reception of video data at the remote communication terminal 170 as a relay destination (destination), the image resolution of the video data is changed by the relay server 162 and then the relay destination as the relay destination. A case where video data is transmitted to the remote communication terminal 170 will be described. FIG. 10A is a diagram illustrating a hardware configuration of the remote communication terminal according to the second embodiment. As shown in FIG. 10A, the remote communication terminal 170 of this embodiment is used for the operation of the CPU 12 that controls the operation of the entire remote communication terminal 170 and the CPU 12 such as an IPL (Initial Program Loader). A ROM 14 storing the program and a RAM 16 used as an execution space of the CPU 12 are included.

  The remote communication terminal 170 further includes an SSD (Solid State Drive) 18, a media drive 20, an operation button 24 that is operated when selecting a destination of the remote communication terminal 170, and the power supply of the remote communication terminal 170 being turned on. And a power switch 26 for switching off and a network I / F 32 for data transmission using the network 110. The SSD 18 controls reading or writing of various data with respect to a flash memory (not shown) that stores various data such as a remote communication terminal program, video data, and audio data according to the control of the CPU 12. The media drive 20 controls reading or writing of data with respect to a recording medium 22 such as an SD card.

  In addition, the remote communication terminal 170 includes an image sensor I / F 34 that controls driving of the external or built-in CCD camera 36 and transmits and receives video data. Instead of the CCD camera 36, a CMOS (Complementary Metal Oxide Semiconductor) image sensor that captures a subject and obtains video data may be used. The remote communication terminal 170 further includes an audio input / output I / F 38 that processes input / output of an audio signal between the external or built-in microphone 40 and the speaker 42. The remote communication terminal 170 further includes a display I / F 44 that transmits video data to an external display 172 under the control of the CPU 12. The display 172 is connected to the display I / F 44 by a cable. This cable may be an analog RGB (VGA) signal cable, a component video cable, an HDMI (High-Definition Multimedia Interface) or a DVI signal cable. Good. Further, the remote communication terminal 170 includes a bus line 30 for electrically connecting the above components.

  FIG. 10B is a hardware configuration diagram of the remote communication management server of this embodiment. The remote communication management server 160 includes a CPU 52 that controls the overall operation, a ROM 54 that stores a program used to drive the CPU 52, a RAM 56 that is used as a work space for the CPU 52, an HDD 58, and a media drive 72. The HDD 58 controls reading or writing of various data with respect to the HD 60 storing various data such as a remote communication management program in accordance with the control of the CPU 52.

  The remote communication management server 160 has a display 62 for displaying various information such as a cursor, menu, window, character, or image, a network I / F 66, and a plurality of keys for inputting characters, numerical values, various instructions, and the like. A keyboard 68, a mouse 70 for selecting and executing various instructions, selecting a processing target, moving a cursor, and the like, a CD-ROM drive 76, and a bus line 64 are provided. A CD-ROM (Compact Disc Read Only Memory) drive 76 controls reading or writing of various data with respect to a CD-ROM 78 as an example of a removable recording medium. Note that the content management server 140, the relay server 162, and the program providing server 164 have the same hardware configuration as that of the remote communication management server 160, and a description thereof will be omitted.

  Hereinafter, the functional configuration of the video output system 100 of the present embodiment will be described. FIG. 11 shows functional blocks of each terminal, device, and server constituting the video output system of the second embodiment. In FIG. 11, a remote communication terminal 170, a remote communication management server 160, and a relay server 162 are connected so that data communication can be performed via the network 110. Further, the program providing server 164 shown in FIG. 9 is omitted in FIG. 11 because it is not directly related to the video conference communication. In the following, the remote communication terminal 170 as a request source requesting the start of a video conference is referred to as “request source terminal 170A”, and the remote communication terminal 170 as a request destination (relay destination) is referred to as “destination terminal”. 170B ".

  The remote communication terminal 170 includes a transmission / reception unit 250, an audio input unit 251, an audio output unit 252, an operation input reception unit 253, a login request unit 254, an imaging unit 255, an image display control unit 256, a storage / read processing unit 257, a delay detection unit. Part 259 and final narrowing part 260. The remote communication terminal 170 also includes a volatile or nonvolatile storage unit 258 constructed by the RAM 16 or flash memory.

  The transmission / reception unit 250 of the remote communication terminal 170 is realized by the CPU 12 and the network I / F 32, and transmits / receives various data to / from other terminals, devices, or servers via the network 110. The transmission / reception unit 250 starts receiving state information indicating the state of each remote communication terminal as a destination candidate from the remote communication management server 160 before starting remote communication with a desired destination terminal 170B. This status information includes not only the operating status (online or offline status) of each remote communication terminal 170, but also detailed information such as whether the remote communication is in progress or whether the user is away from the desk even when online. The state can be indicated.

  The operation input receiving unit 253 is realized by the CPU 12, the operation button 24, and the power switch 26, and receives various inputs from the user. For example, when the user turns on the power using the power switch 26, the operation input receiving unit 253 receives power-on and supplies power. The login request unit 254 is realized by the CPU 12, and triggered by accepting the power-on, the login request information indicating that the transmission / reception unit 250 requests the remote communication management server 160 to log in via the network 110, and the request source As the current IP address of the remote communication terminal 170 is transmitted. When the user turns off the power using the power switch 26, the transmission / reception unit 250 transmits state information indicating that the power is cut off to the remote communication management server 160, and then the operation input receiving unit 253 completely cuts off the power. As a result, the remote communication management server 160 can recognize that the remote communication terminal 170 has been turned off.

  The imaging unit 255 is realized by the CPU 12, the CCD camera 36, and the imaging element I / F 34, and outputs video data obtained by imaging a subject. The voice input unit 251 is realized by the CPU 12 and the voice input / output I / F 38, and after the user's voice is converted into a voice signal by the microphone 40, voice data related to the voice signal is input. The audio output unit 252 is realized by an instruction from the CPU 12 and an audio input / output I / F 38, and outputs an audio signal related to the audio data to the speaker 42 and outputs the audio from the speaker 42. The image display control unit 256 is realized by the CPU 12 and the display I / F 44 and performs control for transmitting video data to the external display 172. The final narrowing unit 260 implements the measurement unit 261, the calculation unit 262, and the final selection unit 263 according to instructions from the CPU 12 in order to perform final narrowing processing that finally narrows down from a plurality of relay servers to one relay server.

  The measurement unit 261 measures the reception date and time when the pre-transmission information is received by the transmission / reception unit 250 for each pre-transmission information received by the transmission / reception unit 250. For each pre-transmission information whose reception date and time is measured by the measurement unit 261, the calculation unit 262 determines the pre-transmission information according to the difference between the measured reception time and the transmission date and time included in the pre-transmission information. The time required from transmission to reception is calculated. The final selection unit 263 finally selects one relay server by selecting the relay server 162 to which the pre-transmission information that requires the shortest required time is relayed among the required times calculated by the calculation unit 262. .

  The delay detection unit 259 is realized by the CPU 12 and detects the delay time of video data or audio data transmitted from another remote communication terminal 170 via the relay server 162. The storage / reading processing unit 257 is executed by the CPU 12 and the SSD 18 and stores various data in the volatile or non-volatile storage unit 258 and performs processing for reading out various data. The storage unit 258 overwrites and stores a terminal ID, a password, video data, and audio data for identifying the remote communication terminal 170 each time it is received. Among these, an image is displayed on the display 172 by the video data before being overwritten, and sound is output from the speaker 42 by the audio data before being overwritten. Note that a terminal ID and a relay server ID described later indicate identification information used to uniquely identify the remote communication terminal 170 and the relay server 162, respectively.

  When operating as an operation terminal that transmits metadata, the remote communication terminal 170 according to the present embodiment can include a content display operation unit (not shown) included in the operation terminal according to the first embodiment. In this case, the remote communication terminal 170 can directly distribute the audio data and video data generated by the microphone 40 and the CCD camera 36 to the projector device 130 as in the first embodiment. Further, the remote communication terminal 170 can provide audio data and video data to another remote communication device 170 using a remote communication conference system including the remote communication management server 160 and the relay server 162.

  In the present embodiment, the projector device 130 can be configured integrally with the remote communication terminal 170 as indicated by a dotted line in FIG. 11, and the projector device 130 passes through the remote communication conference system as sub-contents. Then, the audio data and video data streams can be received from the remote communication terminal 170 and output as video. In this case, in addition to the functional unit shown in the first embodiment, the projector device 130 includes the transmission / reception unit, the login request unit, the storage / read processing unit, the storage unit, the delay detection unit, and the final narrowing-down unit of the remote communication terminal described above. A part.

  The relay server 162 includes a transmission / reception unit 270, a state detection unit 271, a data quality confirmation unit 272, a change quality management unit 273, a data quality change unit 274, and a storage / read processing unit 275. The relay server 162 includes a non-volatile storage unit 276 such as an HD, and a change quality management DB is constructed in the non-volatile storage unit 276. The change quality management DB manages the IP address of the remote communication terminal 170 as a relay destination of video data and the image quality of the video data relayed by the relay server 162 to this relay destination. For example, when passing through a narrow-band route, low-quality video data consisting only of low-resolution video data serving as a base image is relayed, and when the bandwidth is relatively wide, medium-quality video data is When it is very wide, high-quality video data is relayed.

  The transmission / reception unit 270 of the relay server 162 is realized by the CPU 52 and the network I / F 66, and transmits / receives various data to / from other terminals, devices, or servers via the network 110. The state detection unit 271 is realized by the CPU 52 and detects the operating state of the relay server 162. The operating state includes a state of “online”, “offline”, “during remote communication”, or “temporarily interrupted”.

  The data quality confirmation unit 272 is realized by the CPU 52, searches the change quality management DB 276 using the IP address of the destination terminal 170B as a search key, and extracts the image quality of the video data to be relayed. Check the image quality. The change quality management unit 273 is realized by the CPU 52 and changes the contents of the change quality management DB in accordance with the quality information sent from the remote communication management server 160. For example, when there is a delay in receiving video data, the content of the change quality management DB is changed so as to lower the image quality of the video data to be relayed from high image quality to medium image quality in accordance with the quality information. The data quality changing unit 274 is realized by the CPU 52 and changes the image quality of the video data transmitted from the transmission source terminal 170A according to the contents of the changed change quality management DB 276. The storage / reading processing unit 275 is realized by the CPU 52 and the HDD 58 and stores various data in the nonvolatile storage unit and reads various data stored in the nonvolatile storage unit.

  Hereinafter, the remote communication management 160 for managing various information related to remote communication will be described. The remote communication management server 160 includes a transmission / reception unit 280, a terminal authentication unit 281, a state management unit 282, a terminal extraction unit 283, a session management unit 284, a quality determination unit 285, a storage / read processing unit 286, a delay time management unit 288, a terminal A state acquisition unit 289 and a primary narrowing-down unit 290 are provided. In addition, the remote communication management server 160 has a nonvolatile storage unit 287 that can store various data even when the power of the remote communication management server 160 is turned off. Has been built. The non-volatile storage unit 287 further stores a destination list frame. Here, the destination list frame is data including an icon (online, offline, busy, etc. represented by a graphic) indicated by status information (online, offline, busy, etc.) for each destination name.

  In the nonvolatile storage unit 287, a relay server management DB, a terminal authentication management DB, a terminal management DB, a destination list management DB, a session management DB, a priority management DB, and a quality management DB are constructed. The relay server management DB associates and manages the operating state of each relay server 162 for each relay server ID of each relay server 162. The terminal authentication management DB is configured by a terminal authentication management table as shown in FIG. 13A. In the terminal authentication management table, each terminal of all the remote communication terminals 170 managed by the remote communication management server 160 is displayed. Authentication information such as each password is associated with the ID and managed.

  The terminal management DB is configured by a terminal management table as shown in FIG. In the terminal management table, for each terminal ID of each remote communication terminal 170, the remote communication management server 160 receives the destination name when each remote communication terminal 170 is the destination, the operating status of each remote communication terminal 170, and the login request information. The received date and time and the IP address of the remote communication terminal 170 are associated and managed. The destination list management DB is composed of a destination list management table as shown in FIG. 13C. In the destination list management table, the terminal ID of the request source terminal 170A that requests the start of a call in a video conference is stored. Thus, a list including all the terminal IDs of the remote communication terminals 170 registered as candidates for the destination terminal 170B is managed in association with each other.

  The session management DB, for each selection session ID used to execute a session for selecting the relay server 162, the relay server ID of the relay server 162 used for relaying video data and audio data, and the request source terminal 170A. The terminal ID, the terminal ID of the destination terminal 170B, and the like are associated and managed. The priority management DB associates and manages the address priority according to the IP address difference or the maximum data transmission rate value in the relay server 162, and the quality management DB manages the video data in the request source terminal 170A or the destination terminal 170B. The image quality of the video data relayed by the relay server 162 is managed in association with each other according to the delay time.

  The transmission / reception unit 280 of the remote communication management server 160 is executed by the CPU 52 and the network I / F 66 and transmits / receives various data to / from other terminals, devices or servers via the network 110. The terminal authentication unit 281 searches the terminal authentication management DB in the nonvolatile storage unit 287 using the terminal ID and password included in the login request information received via the transmission / reception unit 280 as search keys, and the terminal authentication management DB Terminal authentication is performed by determining whether the same terminal ID and password are managed.

  The state management unit 282 stores and manages the terminal ID of the request source terminal 170A, the operation status of the request source terminal 170A, and the like in association with each other in the terminal management DB in order to manage the operation status of the request source terminal 170A that requested the login. To do. In addition, the state management unit 282 receives state information indicating that the power is to be turned off, sent from the remote communication terminal 170 when the user turns off the power switch 26 of the remote communication terminal 170 from the on state. In response to reception, the operating state of the terminal management table in the terminal management DB is changed to a value indicating offline.

  The terminal extraction unit 283 searches the destination list management DB using the terminal ID of the request source terminal 170A that requested the login as a key, and reads out candidate terminal IDs of the destination terminal 170B that can remotely communicate with the request source terminal 170A. Thus, the terminal ID is extracted. Further, the terminal extraction unit 283 searches the destination list management DB using the terminal ID of the request source terminal 170A that has requested the login as a key, and registers the terminal ID of the request source terminal 170A as a candidate for the destination terminal 170B. The terminal ID of the request source terminal 170A is also extracted.

  The terminal status acquisition unit 289 searches the terminal management DB using the candidate terminal ID of the destination terminal 170B extracted by the terminal extraction unit 283 as a search key, and operates for each terminal ID extracted by the terminal extraction unit 283. Read status. Thereby, the terminal status acquisition unit 289 can acquire the operational status of candidates for the destination terminal 170B that can remotely communicate with the request source terminal 170A that requested the login. Further, the terminal state acquisition unit 289 searches the terminal management DB using the terminal ID extracted by the terminal extraction unit 283 as a search key, and also acquires the operating state of the request source terminal 170A that requested the login.

  The primary narrowing unit 290 performs a primary narrowing process before the final narrowing process in order to support a final narrowing process that finally narrows down from a plurality of relay servers 162 to one relay server 162. Therefore, the primary narrowing-down unit 290 implements a selection session ID generation unit 291, a terminal IP address extraction unit 292, a priority determination unit 293, and a primary selection unit 294 according to instructions from the CPU 52.

  The selection session ID generation unit 291 generates a selection session ID used to execute a session for selecting the relay server 162. The terminal IP address extracting unit 292 searches for the terminal management DB according to the terminal ID of the request source terminal 170A and the terminal ID of the destination terminal 170B included in the start request information transmitted from the request source terminal 170A. The IP address of each remote communication terminal 170 to be extracted is extracted. The primary selection unit 294 selects the relay server 162 by selecting the relay server ID of the relay server 162 whose operation state is “online” among the relay servers 162 managed by the relay server management DB. Do.

  Further, the primary selection unit 294 searches the relay server management DB in accordance with the IP addresses of the request source terminal 170A and the destination terminal 170B extracted by the terminal IP address extraction unit 292, so that the selected relay server 162 Check the IP address. Further, the primary selection unit 294 can further select the relay server 162 by selecting, for each relay server, the upper two relay servers 162 having high points (for example) in the priority evaluation. The priority determination unit 293 refers to the priority management DB and prioritizes each relay server 162 investigated by the primary selection unit 294 according to the IP address and the data transmission rate managed in the relay server management DB. Decide on a degree point.

  The session management unit 284 stores the selection session ID generated by the selection session ID generation unit 291, the terminal ID of the request source terminal, and the terminal ID of the destination terminal in the session management DB of the nonvolatile storage unit 287 in association with each other. And manage. Further, the session management unit 284 stores the relay server ID of the relay server 162 finally selected by the final selection unit 263 of the remote communication terminal 170 for each selection session ID in the session management DB. And manage.

  The quality determination unit 285 determines the image quality of the video data to be relayed to the relay server 162 by searching the quality management DB using the delay time as a search key and extracting the image quality of the corresponding video data. The storage / read processing unit 286 is executed by the HDD 58 and stores various data in the nonvolatile storage unit 287 or reads various data stored in the nonvolatile storage unit 287. The delay time management unit 288 extracts the corresponding terminal ID by searching the terminal management DB using the IP address of the destination terminal 170B as a search key, and further corresponds to the extracted terminal ID in the session management DB. The delay time indicated by the delay information is stored and managed.

  As described above, in the second embodiment, the remote communication terminal 170 can operate as an operation terminal and can transmit metadata to the projector device 130. In the embodiment in which the projector device 130 is configured integrally with the remote communication terminal, the projector device 130 receives the audio data and video data transmitted from the remote communication terminal 170 via the relay server 162 as a stream. Video can be output. Further, in the remote communication conference system, the remote communication management server 160 manages the status information of each remote communication terminal 170 and distributes it to each remote communication terminal 170. It is possible to grasp 170 statuses such as online, offline, and away.

  Hereinafter, the projector apparatus 130 that can notify the detailed operation state such as whether it is online, offline, or being projected using the state information will be described. FIG. 12 is a block diagram showing a schematic configuration of projector apparatus 130 having a part of the functions of remote communication terminal 170. The projector apparatus 130 shown in FIG. 12 includes a control unit 210 and a video display unit 240. The control unit 210 includes a transmission / reception unit 250, a login request unit 254, a storage / read processing unit 257, and a storage unit included in the remote communication terminal 170, in addition to the functional units included in the projector device of the first embodiment shown in FIG. 258. Further, the control unit 210 of the projector apparatus 130 shown in FIG. 12 is in an operation state including the power supply state such as online or offline, and the video output state such as during projection, playback, during projection pause, during search. A state detection unit 264 that detects a change is provided. These functional units are realized by a CPU (not shown).

  The login request unit 254 makes a login request to the remote communication management server 160 via the network 110 by the transmission / reception unit 250 when the power-on is accepted. When the projector device 130 can log in as a remote communication terminal, the state detection unit 264 causes the storage / read processing unit 257 to store state information indicating that it is online in the storage unit 258. In addition, the state detection unit 264 detects that the projector device 130 is turned off when the power switch of the projector device 130 is turned off by the user, and the transmission / reception unit 250 disconnects the power to the remote communication management server 160. The information is transmitted and the power supply is then completely disconnected. As a result, the remote communication management server 160 can recognize that the projector device 130 has been turned off from being turned on. The same applies to changes in other states such as online, during projection, during playback, during search, and during playback pause.

  Hereinafter, a log-in process as a preparation stage in which the remote communication terminal starts remote communication will be described. FIG. 14 is a sequence diagram showing processing in a preparation stage for starting remote communication between a plurality of remote communication terminals. FIG. 14 illustrates the case where the device for logging in is the remote communication terminal 170a. However, devices that operate as other remote communication terminals such as the other remote communication terminals 170b and 170c and the projector device 130 are also illustrated. Similar processing can be performed.

  The process shown in FIG. 14 starts from step S200 in response to the user turning on the power switch 26 of the remote communication terminal 170a. The operation input reception unit 253 of the remote communication terminal 170a Is turned on and the projector device 130 is turned on. In step S201, the login request unit 254 of the remote communication terminal 170a transmits login request information indicating a login request from the transmission / reception unit 250 to the remote communication management server 160 via the network 110 when the power-on is received. To do. This login request information includes a terminal ID and a password for identifying the own terminal as a request source.

  In step S202, the terminal authentication unit 281 of the remote communication management server 160 uses the terminal ID and password included in the login request information received via the transmission / reception unit 280 as search keys, and the terminal authentication management of the nonvolatile storage unit 287. The terminal is authenticated by searching the DB and determining whether the same terminal ID and password are managed in the terminal authentication management DB. If it is determined that the request is a login request from a remote communication terminal having a valid use authority, in step S203, the state management unit 282 indicates the terminal management DB with the terminal ID and destination name of the request source terminal 170a. The record is stored in association with the operating state, the reception date and time when the login request information is received, and the IP address of the remote communication terminal.

  In step S204, the transmission / reception unit 280 transmits the authentication result information indicating the authentication result obtained by the terminal authentication unit 281 to the request source terminal 170a that has made the login request via the network 110. In the present embodiment, the description will be continued below when the terminal authentication unit 281 determines that the terminal has a valid use authority.

  When the remote communication terminal 170a receives the authentication result information indicating the result of the determination that the remote communication terminal 170a is a terminal having a right to use, the transmission / reception unit 250 requests a destination list via the network 110 in step S205. The destination list request information indicating that it is to be transmitted is transmitted to the remote communication management server 160. Thereby, the transmission / reception unit 280 of the remote communication management server 160 receives the destination list request information.

  In step S206, the terminal extraction unit 283 of the remote communication management server 160 searches the destination list management DB using the terminal ID of the request source terminal 170a as a search key, and can send a remote communication with the request source terminal 170a. The candidate terminal ID and the destination name corresponding to the terminal ID are read out and extracted. In step S207, the transmission / reception unit 280 of the remote communication management server 160 reads the destination list frame from the non-volatile storage unit 287 via the storage / read processing unit 286, and extracts the destination list frame and the terminal extraction unit 283. "Destination list information (destination list frame, terminal ID, destination name)" including the received terminal ID and destination name is transmitted to the request source terminal 170a. Thereby, in the request source terminal 170a, the transmission / reception unit 250 receives the destination list information, and the storage / reading processing unit 257 stores the destination list information in the storage unit 258.

  In step S208, the terminal extraction unit 283 searches the destination list management DB using the terminal ID of the request source terminal 170A that requested the login as a search key, and is a candidate for the destination terminal 170B that can remotely communicate with the request source terminal 170a. Extraction is performed by reading out the terminal ID and the destination name corresponding to the terminal ID. In step S209, the terminal state acquisition unit 289 of the remote communication management server 160 searches the terminal management DB using the candidate terminal ID of the destination terminal 170B extracted by the terminal extraction unit 283 as a search key, and the terminal extraction unit For each terminal ID extracted by H.283, the corresponding operating state is read to obtain each operating state of the remote communication terminal as a destination candidate. In step S210, the transmission / reception unit 280 transmits “terminal status information” including the terminal ID as the search key used in step S208 and the operating status of the corresponding destination terminal 170B via the network 110. It transmits to the request source terminal 170a. In addition, the transmission processing in step S210 may include transmitting the terminal ID of the request source terminal 170a and status information indicating the operating status of the request source terminal 170a.

  In step S211, the storage / reading processing unit 257 of the request source terminal 170a stores the terminal status information received from the remote communication management server 160 in the storage unit 258, and the image display control unit 256 is stored in the storage unit 258. The status of the destination candidate terminal is displayed on the display 172 according to the destination list information and the terminal status information. In step S212, the terminal extraction unit 283 of the remote communication management server 160 searches the destination list management DB using the terminal ID of the request source terminal 170a that requested the login as a search key, and sets the terminal ID of the request source terminal 170a as the destination. The terminal ID of another request source terminal 170A registered as a candidate for the terminal 170B is extracted.

  In step S213, the terminal status acquisition unit 289 searches the terminal management DB using the terminal ID of the request source terminal 170a that has requested the login as a search key, and acquires the operating status of the request source terminal 170a that has requested the login. To do. In step S214 and step S216, the transmission / reception unit 280, among the remote communication terminals associated with the terminal ID extracted in step S212, has a remote communication terminal (for example, “online” in the terminal management DB) (for example, 170b, 170c), the “terminal status information” including the terminal ID of the request source terminal 170a acquired in step S212 and the operating status “online” is transmitted. As a result, the terminal ID and the operating state “online” of the request source terminal 170a that requested the log-in to each of the other destination terminals (170b and 170c) that can talk using the request source terminal 170a that requested the log-in as the destination. Can be communicated.

  In step S215 and step S217, the storage / reading processing unit 257 of the remote communication terminals 170b and 170c stores the terminal status information received from the remote communication management server 160 in the storage unit 258, and the image display control unit 256 The statuses of the destination candidate terminals of the remote communication terminals 170b and 170c are displayed on the display 172 in accordance with the destination list information and terminal status information stored in the storage unit 258. With the processing shown in FIG. 14, the remote communication terminal 170 newly logged in to the remote communication conference system is recognized as a terminal that can communicate online with other remote communication terminals 170.

  Hereinafter, a process in which the state of the projector device 130 is changed when the projector device operating as a remote communication terminal starts projection and the change is made known to other remote communication terminals will be described. FIG. 15 is a sequence diagram showing processing executed in response to a change in the state of projector device 130. The processing shown in FIG. 15 is started from step S300 when the state detection unit 264 of the projector device 130 shown in FIG. 12 detects that the projector device 130 has changed from “online” to “projecting”, for example.

  In step S <b> 301, the transmission / reception unit 250 of the projector device 130 transmits state information indicating that the state has been changed to “projecting” to the remote communication management server 160. Thereby, the remote communication management server 160 side can grasp that the projector device 130 has changed from “online” to “projecting”. In step S302, the state management unit 282 of the remote communication management server 160 indicates the terminal ID (video output device ID) and the destination name of the projector device 130 in order to manage the operating state of the projector device 130 that has transmitted the state information. The record is stored in the terminal management DB in association with the operation status and the received reception date and time. In step S303, the terminal extraction unit 283 searches the destination list management DB using the terminal ID (video output device ID) of the projector device 130 as a search key, and uses the terminal ID (video output device ID) of the projector device 130 as the destination terminal. The terminal ID of another request source terminal 170A registered as a candidate for 170B is extracted.

  In step S304, the terminal status acquisition unit 289 of the remote communication management server 160 searches the terminal management DB using the terminal ID of the projector device 130 as a search key, and acquires the operating status of the projector device 130. In step S305 and step S307, the transmission / reception unit 280, among the remote communication terminals having the terminal ID extracted in step S303, has a remote communication terminal (for example, 170b) whose operation state is “online” in the terminal management DB. , 170c), the “terminal state information” including the terminal ID of the projector device 130 acquired in step S304 and the operating state “projecting” is transmitted. Thereby, the terminal ID of the projector device 130 and the operating state “projecting” are displayed for each of the other remote communication terminals 170b and 170c that can remotely communicate with the projector device 130 that has notified the change of state. Communicated.

  In steps S306 and S308, the storage / reading processing unit 257 of the remote communication terminals 170b and 170c stores the terminal status information received from the remote communication management server 160 in the storage unit 258, and the remote communication terminals 170b and 170c. The image display control unit 256 displays the status of the destination candidate terminals of the remote communication terminals 170b and 170c on the display 172 in accordance with the terminal status information stored in the storage unit 258.

  With the processing shown in FIG. 15, the other remote communication terminals 170b and 170c that can communicate with the projector device 130 know that the projector device 130 has shifted to the “projecting” state. At this time, the other remote communication terminal 170b instructs the other projector apparatus to which it is transmitting metadata to display an icon or the like indicating that the projector apparatus 130 is “projecting” as sub-contents. By transmitting the metadata, an icon or the like indicating that the projector device 130 is “projecting” can be output to the other projector device.

  The metadata can have the same data structure as that shown in FIG. 4 indicating the address indicating the storage position of the icon image. Note that the status display of the projector device grasped by the status detection unit 264 is difficult to specify in detail on the operation terminal side. Therefore, according to the output content generation rule 410 shown in FIG. 5, the icon image is displayed at a predetermined allocation position and allocation size. Can be defined and displayed accordingly.

  FIG. 16 shows the projection of output contents individually projected from the two projector apparatuses 130a and 130b by transmitting metadata indicating an icon display indicating “projecting” in the video output system of the second embodiment. It is a figure which shows a screen. The projection screen 360 of the projector device 130b shown in FIG. 16 displays the same document as the projection screen region 342 and the projection screen region 346 of the projector device 130a in the projection screen region 362 and the projection screen region 366, while in the projection screen region 364. A moving image having a different content from the projection screen 340 of the projector device 130a is displayed.

  In the projection screen area 364 of the projector device 130b, for example, an image captured by a CCD camera of a remote communication terminal arranged at the same location as the counterpart projector device 130a is displayed, and in the projection screen area 344 of the projector device 130a. The video imaged by the CCD camera of the remote communication terminal placed at the same location as the counterpart projector device 130b is displayed and projects the video of the other party. Further, in the projection screen area 368 of the projector device 130b, an icon indicating the status information of the projector device 130a at the counterpart location (an example of an icon indicating that projection is being performed in the example of FIG. 16) is displayed, and the projector device 130a. In the projection screen area 348, an icon indicating the status information of the projector device 130b at the counterpart location is displayed, and the status of the projector devices arranged at the counterpart location is displayed.

  As described above, in the video output system 100 according to the second embodiment, the function of notifying the status information of the remote communication conference system is used to display the operating status and operating status of the projector device 130 operating as a remote communication terminal. Can be displayed. In the second embodiment described above, the projector device 130 has been described as operating as a remote communication terminal and transmitting its state information to the remote communication management server 160. However, in an embodiment in which the projector device 130 is not configured integrally with the remote communication terminal, the projector device 130 notifies the remote communication terminal that is transmitting metadata to itself of its own status information, and the remote communication terminal The state information can also be transmitted to the remote communication management server 160 via the route.

[Third Embodiment]
The video output system according to the third embodiment will be described below. The video output system of the third embodiment described below includes additional functions in addition to the configuration of the first embodiment. The video output system according to the third embodiment has the same configuration as the video output system 100 according to the first embodiment, and therefore, the following description will focus on the differences. FIG. 17 is a diagram illustrating an outline of a video output system 500 according to the third embodiment. In the video output system 500 shown in FIG. 17, in addition to the operation terminal 520, the projector device 530, and the content management server 540, a projector management server 550 that provides a conversion module required by each projector device 530, and each video output device A history management server 560 that manages usage history information is connected to each other via a network 510.

  The projector device 530 shown in FIG. 17 identifies the user of the operation terminal 520, and projects the output content by changing the content corresponding to the identified user. The projector management server 550 shown in FIG. 17 stores the conversion module 552 corresponding to various content formats, and sends the requested conversion module in response to a request from the projector device 530. Make it available. In the embodiment to be described, when the necessary conversion module does not exist on the projector device 530 side, the projector device 530 downloads and installs the necessary conversion module from the projector management server 550 through a predetermined procedure such as license acquisition. In the following description, it is assumed that the conversion module can be used. However, in other embodiments, when a program for various conversion modules already exists on the projector device 530 side and the conversion module is not activated on the projector device 530 side, the conversion is performed through a predetermined procedure such as license acquisition. The module may be configured to be usable after being activated.

  The history management server 560 shown in FIG. 17 includes a metadata history DB 562 and a content history DB 564, acquires usage history information managed internally by each video output device, and uses the usage history in the metadata history DB 562 and the content history DB 564. Save and manage information. As a result, the usage history information of each video output device is synchronously backed up to the history management server 560 and managed centrally.

  Hereinafter, the operation of the video output system 500 of the third embodiment will be described in detail. FIG. 18 is a block diagram illustrating a schematic configuration of a video output system according to the third embodiment. The projector device 530a shown in FIG. 18 includes a control unit 610 and a video display unit 660. The control unit 610 is configured to include a user identification unit 640 and a conversion module management unit 642 in addition to the network I / F 620, the metadata reception / analysis unit 622, the content acquisition unit 624, and the output content generation unit 626. The

  The user identification unit 640 performs a processing procedure for identifying the user of the operation terminal 520, and specifies the user who is the transmission source of the metadata. The user identifying unit 640 identifies the user or the operation terminal 520 of the user using a technique such as XMPP or SIP, for example. In another embodiment, the user identifying unit 640 is implemented by incorporating a web server function, and a login screen for the projector device 530a is displayed on the web browser on the operation terminal 520, thereby identifying the user. Also good.

  In the video output system 500 of the third embodiment, when the user is specified, the output content generation rule applied to each user is changed, and the URI of the access-restricted resource is described in the metadata It is possible to access resources using the authentication information held corresponding to the user and change the storage destination of the usage history information for each user.

  FIG. 19 illustrates a data structure of data managed for each user. FIG. 19A illustrates the data structure of an output content generation rule (hereinafter referred to as a user rule) set for each user. After the user is specified, the output content generation unit 626 replaces the output content generation rule used in the first embodiment or adds it to the output content generation rule of the first embodiment as shown in FIG. It is possible to apply user rules preset for each user as shown in FIG. As a result, even when the same output content is reproduced, it is possible to output the output content with a different appearance depending on the user.

  A user rule 700 shown in FIG. 19A includes a user identification value 700a that uniquely identifies a user, an application target sub-content type 700b, and a mode 700c that is set for the application target sub-content. , And coordinates 700d set for the sub-content to be applied. Such a user rule 700 can use, for example, layout information not defined in the metadata for supplementing the first stage. In this case, the output stage generation rule similar to that of the first embodiment that does not depend on the user can be applied to those not defined in the user rule, and the second stage supplement can be performed.

  FIG. 19B exemplifies a data structure of user data that holds a history storage destination and authentication information set for each user. The user data 710 shown in FIG. 19B includes a user identification value 710a that uniquely identifies the user, a storage destination 710b of usage history information, an ID 710c that can be used when accessing resources, and a password, for example. Authentication information 710d. After the user is specified, the content acquisition unit 624 notifies the ID 710c and the authentication information 710d when authentication is requested when accessing the resource indicated by the URI in the metadata, and acquires the sub-content. As a result, the authority of the user can be temporarily delegated to the projector device 530a, and even sub-contents whose access is restricted can be acquired and incorporated into the output content. Further, the history recording unit 632 can refer to the user data 710 and change the storage destination of usage history information including metadata corresponding to the user identification value, output content, sub-content, and stored content management table. . As shown in FIGS. 20 and 26, user identification values 720b and 730b can be added to the metadata and the stored content management table, respectively.

  Furthermore, in the video output system 500 of the present embodiment, the metadata reception / analysis unit 622 of the projector device 530a describes a video output device ID other than the own device in the metadata as shown in the first row of FIG. The metadata can be transferred to a video output device other than the own device. This causes the one or more other video output devices operating as slaves to output content with different contents centered on the projector device 530a operating as the master, and the output contents of these video output devices are output to the projector device 530a. It is possible to accumulate in a unified manner. In the example to be described, in the transfer process, it is assumed that projector device 530a operates as a master and projector device 530b operates as a slave.

  FIG. 21 is a diagram illustrating a projection screen of output content that is individually projected from the two projector apparatuses 530a and 530b by the metadata transfer according to the third embodiment. The projection screen 810 of the projector device 530b shown in FIG. 21 displays the same document as the projection screen region 802 in the projection screen region 812, while the projection screen 800 of the projector device 530a is displayed in the projection screen region 814 and the projection screen region 816. Text and movies with different contents are displayed. As described above, in the video output system 500 according to the third embodiment, output contents having different contents can be individually output from a plurality of video output apparatuses. Note that the number of video output devices that can be used simultaneously is not limited to two. This configuration is useful, for example, when a conference is performed remotely while sharing materials.

  Referring to FIG. 18 again, the conversion module management unit 642 includes a management unit 644 that manages the conversion module 646. The management unit 644 receives the projector management server 550 and the projector management server 550 in response to a manual command from an operator using an operation panel or an operation terminal provided in the projector device 530 when there is no conversion module necessary for generating output content. Communicate and perform a procedure to validate the desired conversion module. The projector management server 550 includes a conversion module providing unit 648 that provides a conversion module 552 corresponding to the format of each content. In response to a request from the conversion module management unit 642 of the projector device 530, the license management procedure is appropriately performed. And provide the requested conversion module.

  The output content generation unit 626 of the projector device 530a according to the third embodiment includes a conversion module calling unit 638 in addition to the conversion module 628 and the content composition unit 630. In the projector device 530a of the present embodiment, the conversion module 646 managed by the conversion module management unit 642 is called as necessary in accordance with the format of the sub-content for which output is requested, and the output content generation unit A conversion module 628 is implemented on the execution space 626. When the conversion module requested by the conversion module calling unit 638 is not held, the management unit 644 downloads a necessary conversion module from the projector management server 550 and passes it to the output content generation unit 626.

  Hereinafter, the operation of the video output process executed by the video output system of the third embodiment will be described with reference to a flowchart. 22 and 23 are flowcharts showing the operation of the video output method executed by the projector device of the third embodiment. Note that. It should be noted that in FIGS. 22 and 23, processing is linked by points A and B in the figure. The method shown in FIGS. 22 and 23 is started from step S400 in response to, for example, activation of projector device 530. In step S401, the user identification unit 640 loops step S401 and waits until the user logs in (during NO). When the login process is started in step S401 (YES), the process proceeds to step S402, and the user identifying unit 640 identifies the user in step S402 and uses corresponding to the user identified in step S403. The user rules and apply them.

  In step S404, the metadata reception / analysis unit 622 loops the process in step S404 and waits for metadata until the metadata is sent (during NO). If the metadata is sent in step S404 (YES), the process proceeds to step S405, where the metadata reception / analysis unit 622 receives the metadata. In step S406, the history recording unit 632 receives the metadata. The metadata received by the analysis unit 622 is stored as usage history information.

  In step S407, the metadata reception / analysis unit 622 analyzes the received metadata and obtains an analysis result. In step S <b> 408, the metadata reception / analysis unit 622 determines whether transfer is necessary for another video output device as a result of the analysis. If it is determined in step S408 that transfer is necessary (YES), the process branches to step S409. In step S409, the metadata reception / analysis unit 622 transfers the received metadata to a video output device other than the own device described in the metadata. In step S410, it is checked whether or not the video output device ID of the own device is described in the metadata, and it is determined whether or not processing on the own device is necessary. If it is determined in step S410 that the processing on the own device is unnecessary (NO), the processing loops to step S404 and waits for the next metadata.

  On the other hand, if it is determined in step S408 that the transfer is not required (NO) and if it is determined in step S410 that the process is required (YES), the process proceeds to step S411. In step S411, the process is branched according to the control event depending on the content type and mode specified in the metadata. If the command type is specified in the metadata and the “summary output” mode is specified (summary output), the process branches to step S420 in step S411. If the command type is specified in the metadata and the “content end” mode is specified (content end), the process branches to step S417 in step S411. On the other hand, if a normal type other than the command type is specified in the metadata (normal), the process branches to step S501 in FIG.

  In step S501 of FIG. 23, the content acquisition unit 624 determines whether or not content acquisition is necessary. If it is determined in step S501 that content acquisition is necessary (YES), the process proceeds to step S502. In step S502, the content acquisition unit 624 acquires sub-contents based on the URI described in the metadata, or starts acquisition processing. Note that when authentication information is required at the time of acquisition of sub-content, the corresponding ID 710c and authentication information 710d of user data are used.

  In step S503, the history recording unit 632 accumulates the acquired sub-contents or starts accumulation. In step S504, the output content generation unit 626 applies the content generation rule and determines the final allocation position and allocation size. If it is determined in step S501 that content acquisition is unnecessary (NO), the process proceeds directly to step S504.

  In step S505, the output content generation unit 626 specifies a format from the extension, header, and the like of the acquired sub content, and determines whether it is necessary to read out the conversion module. Here, it is determined that the conversion module corresponding to the acquired sub-content format is necessary when it is not read into the execution space of the output content generation unit 626. If it is determined in step S505 that reading of the conversion module is unnecessary (NO), the process proceeds to step S412 in FIG. On the other hand, if it is determined in step S505 that the conversion module needs to be read (YES), the process proceeds to step S506.

  In step S506, the conversion module management unit 642 determines whether a necessary conversion module exists in the conversion module 646 managed by the conversion module management unit 642. If it is determined in step S506 that the required module does not exist (NO), the process proceeds to step S507, and the conversion module management unit 642 communicates with the projector management server 550 to inform the sub-content format. The necessary conversion module is downloaded, and the process proceeds to step S508. On the other hand, if it is determined in step S506 that the necessary conversion module exists (YES), the process directly branches to step S508. In step S508, the output content generation unit 626 reads and activates the conversion module, and advances the process to step S412 in FIG.

  Referring to FIG. 22 again, in step S412, the output content generation unit 626 confirms the generation state of the output content and determines whether to start generating the output content or to update the output content. If it is determined in step S412 that output content generation is to be started (start), the process proceeds to step S413. In step S413, the output content generation unit 626 is determined by applying metadata and content generation rules. The generation of output content is started under the specified conditions. In step S414, the history recording unit 632 starts recording the generated output content, and in step S415, the video display unit 660 starts outputting the generated output content. Subsequently, the process loops to step S404 and waits for the next metadata. Note that the processing from step S416 to step S421 in FIG. 22 is the same as the processing from step S114 to step S119 shown in FIG. 8 except that the processing loops from step S416, step S419, and step S421 to step S404. Therefore, the explanation is omitted.

  FIG. 24 is a block diagram illustrating a schematic configuration of functions related to usage history information in the video output system of the third embodiment. It should be noted that in FIG. 24, a part of the detailed configuration shown in FIG. 18 is simplified. The control unit 610 of the projector device 530a shown in FIG. 24 further includes a history search unit 650 and a data synchronization unit 654. The operation terminal 520 further includes a search request unit 652 that issues a search query to the history search unit 650 and receives and displays the search result. The history management server 560 includes a synchronization management unit 656, and manages synchronization processing between the management target video output device, the metadata history DB 562, and the content history DB 564.

  The history search unit 650 stores metadata in response to a search request instructed from the search request unit 652 of the operation terminal 520 or another management terminal, or a search request instructed using the operation panel of the projector device 530. The metadata in the unit 634 and the information in the stored content management table in the content storage unit 636 are searched, information corresponding to the search query is extracted, and returned as a search result. For example, it becomes possible to search for output contents output in the past using a time range or the name of a sub-content as a search query, and metadata associated with the output contents can be acquired.

  The data synchronization unit 654 monitors the metadata storage unit 634 and the content storage unit 636, and communicates with the synchronization management unit 656 of the history management server 560 when the synchronization condition is satisfied, thereby communicating with the metadata storage unit 634 and the content. The use history information accumulated in the storage unit 636 is synchronized. For example, the capacity of unsynchronized data accumulated in the metadata storage unit 634 and the content storage unit 636 exceeds a certain threshold, and the remaining capacity of the storage capacity allocated to the metadata storage unit 634 and the content storage unit 636 The synchronization condition may be that it is less than a certain threshold, that the projector device 530 is activated or shut down, that a certain period has elapsed, or that a specific day, day of the week, or time has arrived. Such synchronization conditions are set in advance using an operation panel provided in the operation terminal 520 (or other management terminal) or the projector device 530, and stored as setting data.

  The usage history information synchronization process executed in the video output system 500 of the third embodiment will be described below with reference to flowcharts. FIG. 25 is a flowchart showing a synchronization process executed between the projector device and the history management server of this embodiment. The synchronization process shown in FIG. 25 is started from step S600 in response to, for example, activation of projector device 530. In step S601, the data synchronization unit 654 reads the synchronization condition described in the setting data. On the other hand, on the history management server 560 side, for example, in response to the activation of the history management server 560, the process starts from step S700. In step S701, the synchronization management unit 656 waits for communication from the management target video output apparatus, and loops the process in step S701 until the synchronization process starts (during NO).

  On the projector device 530 side, the data synchronization unit 654 determines whether or not the synchronization condition is satisfied in step S602, and loops the process in step S602 until the synchronization condition is satisfied (during NO). If it is determined in step S602 that the synchronization condition is satisfied (YES), the process proceeds to step S603. In step S603, the data synchronization unit 654 communicates with the history management server 560 and starts the synchronization process. . In step S604, the data synchronization unit 654 reads usage history information that has not yet been subjected to synchronization processing (hereinafter referred to as synchronization data), transmits it to the history management server 560 in step S605, and in step S606. A response is awaited until a synchronization processing completion response is received (during NO).

  On the other hand, when the synchronization process starts on the history management server 560 side (YES in S701), the process proceeds to step S702. In step S702, the synchronization management unit 656 receives the synchronization data from the projector device 530. In step S703, the synchronization management unit 656 stores the metadata of the received synchronization data in the metadata history DB 562 in association with the projector device 530 that is the transmission source. In step S704, the synchronization management unit 656 stores the stored content management table, sub-contents, and output content data in the received synchronization data in the content history DB 564 in association with the transmission source projector device 530. In step S705, the synchronization management unit 656 responds to the transmission source projector device 530 that the synchronization processing has been completed.

  In step S606, when a response to the completion of the synchronization process is received from the history management server 560 (YES), the process proceeds to step S607. In step S607, the data synchronization unit 654 sets a flag indicating that the synchronization is completed in the information included in the synchronization data, loops the process to step S602, and then waits until the synchronization condition is satisfied. For example, as shown in FIGS. 20 and 26, synchronization flags 720i and 730h are attached to the metadata 720 to be stored and the stored content management table 730, and the synchronization record is notified as “completed” upon receiving notification of completion of the synchronization processing. To do. The records whose synchronization flags 720i and 730h are “completed” can be appropriately deleted or overwritten.

  As described above, according to the video output system 500 of the third embodiment, by specifying the user, the output content generation rule to be applied for each user is changed, and the appearance and contents are changed according to the user. Different output contents can be output. Furthermore, even if the content is secured by accessing the resource using the authentication information held corresponding to the user when the URI of the resource whose access is restricted is described in the metadata, It is possible to output as video while maintaining security. Further, since the usage history is grasped according to the user, it becomes possible to charge for each user according to the usage status of each user.

  Furthermore, according to the video output system 500 of the third embodiment, a plurality of video output devices can be linked to individually output output contents, which is useful when, for example, a remote conference is performed while sharing materials. It is. Also, according to the video output system 500 of the third embodiment, when a new format appears due to technological progress, or when it is necessary to use a format without a license or a format that has not been downloaded, It becomes possible to respond flexibly. Since the conversion module can be acquired via the network as necessary, the capacity of the storage area reserved for the conversion module program can be reduced, which is advantageous from the viewpoint of cost.

  Furthermore, according to the video output system 500 of the third embodiment, since the usage history of the projector device 530 can be transmitted to an external server and synchronized, a large amount of usage history is stored in the projector device 530 itself. This is not necessary, and the capacity of the auxiliary storage area to be provided can be suitably reduced, which is advantageous from the viewpoint of cost.

[Fourth Embodiment]
The video output system according to the fourth embodiment will be described below. In the description of the third embodiment described above, it has been described that the use history information is centrally managed by the single history management server 560. However, in the video output system of the fourth embodiment described below, A history management server is provided on a plurality of networks, and the remote communication management server 580 centrally manages which history management server 560 manages which conference information of which projector device 130 is managed. Since the video output system of the fourth embodiment described below is similar to that of the third embodiment, the same function means are referred to using the same reference numerals, and the differences are described below. The explanation is centered.

  FIG. 27 is a diagram schematically illustrating a video output system 500 according to the fourth embodiment. A video output system 500 shown in FIG. 27 includes a remote communication management server 580, a relay server 582, in addition to the operation terminal 520, the projector device 530, the content management server 540, and the projector management server 550 shown in the third embodiment. The program providing server 584 includes a remote communication terminal 570 and a display 572. In the fourth embodiment, the video output system 500 includes a plurality of history management servers 560a and 560b.

  The remote communication terminal 570, the relay server 582, and the program providing server 584 each have the same configuration as that described in the second embodiment. The remote communication management server 580 generally has the same hardware configuration as that shown in FIG. 10B and the functional block shown in FIG. 11, but the remote communication management server 580 of this embodiment further includes a history. A configuration for managing history information stored in the management server 560 is provided. 27 shows the detailed configuration of the network 510. The configuration of the network 510 has the same configuration as that of the network 110 of the second embodiment shown in FIG. Omit.

  The functional configuration of the video output system of the fourth embodiment will be described below. FIG. 28 shows functional blocks of each terminal, device, and server constituting the video output system of the fourth embodiment. In FIG. 28, an operation terminal 520, a projector device 530, a remote communication management server 580, and history management servers 560a and 560b are connected so as to perform data communication via a network 510. Note that the relay server 582 and the program providing server 584 are omitted in FIG. 28 because they are not directly related to metadata history management. In FIG. 28, the operation terminal 520 is shown as a terminal that requests the search of usage history information, but it goes without saying that the remote communication terminal 570 may play the role.

  The control unit 610 of the projector device 530 according to the fourth embodiment includes a network I / F 620, a metadata reception / analysis unit 622, a content acquisition unit 624, an output content generation unit 626, and a history recording unit 632 illustrated in FIGS. In addition to user identification unit 640, conversion module management unit 642, history search unit 650, and data synchronization unit 654, transmission / reception unit 670, login request unit 672, storage / read processing unit 674, and storage unit 676 are included. Consists of. Note that the configuration of the transmission / reception unit 670, the login request unit 672, the storage / read processing unit 674, and the storage unit 676 is the same as that shown in FIG.

  The history recording unit 632 of this embodiment stores an accumulated content management table 740 as shown in FIG. 30 in the content storage unit when the projector device 530 receives the metadata and reproduces the output content. The accumulated content management table 740 shown in FIG. 30 is configured by adding a content attribute field 740g to the table shown in FIG. The content attribute field 740g stores, for example, a conference identification value for identifying a conference to be held.

  The conference identification value can be a unique value that is assigned to each conference when metadata for notifying the start or end of the conference is received from the operation terminal 520. As the conference identification value, a conference name input by the user on the operation terminal 520 can be used. For example, metadata indicating the start and end of the conference is transmitted from the operation terminal 520 to the project device 530, and at the timing when the conference ends, the operation terminal 520 notifies the projector device 530 of a conference identification value for identifying the conference. For the metadata stored from the start to the end, the projector device 530 can add the conference identification value for identifying the conference to the data to be synchronized and perform data synchronization.

  The data synchronization unit 654 monitors a metadata storage unit and a content storage unit (not shown), and when a synchronization condition such that the volume of unsynchronized data exceeds a certain threshold is satisfied, a predetermined history management server 560 is obtained. The synchronization management unit 656 communicates with each other to synchronize the usage history information stored by itself. The synchronization-destination history management server 560 can be determined by setting in advance or by selecting an arbitrary server from among the history management servers that are online at the start of the synchronization process. Furthermore, after the synchronization processing to the history management server 560 is completed, the data synchronization unit 654 of the present embodiment transmits information related to the synchronization processing to the remote communication management server 580 via the transmission / reception unit 670, The fact that the history management server 560 and the history information are synchronized is notified.

  The remote communication management server 580 includes a transmission / reception unit 682, a terminal authentication unit (not shown), a state management unit (not shown), a terminal extraction unit (not shown), and a session management unit (not shown) shown in FIG. (Not shown), a quality determination unit (not shown), a storage / reading processing unit 686, a delay time management unit (not shown), a terminal status acquisition unit (not shown), and a primary screening unit (not shown) In addition to this, a history management unit 684 is provided. The non-volatile storage unit 688 of the remote communication management server 580 includes a relay server management DB, a terminal authentication management DB, a terminal management DB, a destination list management DB, a session management DB, a priority management DB, and a quality shown in FIG. In addition to the management DB, a metadata history management DB is constructed.

  When the history management unit 684 receives notification from the data synchronization unit 654 of the projector device 530 that the history information has been synchronized with the predetermined history management server 560, the history management unit 684 receives the terminal ID (video output device ID) of the projector device 530, and The terminal ID (history management server ID) of the history management server 560 is associated with the content attribute and stored in the metadata history management DB. Here, the remote communication management server 580 only needs to be able to grasp which history management server 560 stores the use history information output from which projector device 530 in which conference, so the data synchronization unit 654 However, it is not necessary to notify the history management unit 684 of all the metadata related to the synchronization processing, and it is sufficient to notify the terminal ID of the projector device 530, the terminal ID of the history management server 560, and the content attribute.

  FIG. 31 shows a data structure of a metadata history management table constituting the metadata history management DB. As shown in FIG. 31, the metadata history management table 750 includes a terminal ID (video output device ID) 750a of the projector device 530, a terminal ID (history management server ID) 750b of the synchronization history management server 560, and user identification. The value 750c, the content attribute 750d, the start date / time 750e, and the end date / time 750f are associated with each other, and which history management server 560 and which projector device 530 projects and which conference content is managed is recorded. .

  FIG. 29 is a flowchart illustrating a synchronization process executed between the projector device, the history management server, and the remote communication management server according to the fourth embodiment. The synchronization process shown in FIG. 29 is substantially similar to the synchronization process shown in FIG. 25, the process executed by the projector device 530 in steps S800 to S806, and the process executed by the history management server 560 in steps S900 to S905. Since this is the same as the processing from step S600 to step S606 and the processing from step S700 to step S705 shown in FIG. 25, the processing from step S807 will be described below.

  In step S806, when a response to the completion of the synchronization process is received from the history management server 560 (YES), the process proceeds to step S807. In step S807, the data synchronization unit 654 of the projector device 530 sets a flag indicating that synchronization has been completed in the information included in the synchronization data. In step S808, the data synchronization unit 654 transmits information related to the synchronization processing to the remote communication management server 580 via the transmission / reception unit 670, indicating that the use history information is synchronized with the predetermined history management server 560. Notification, loop the process to step S802, and then wait until the synchronization condition is satisfied.

  On the other hand, when the remote communication management server 580 is notified of the synchronization information (YES in S1001), the process proceeds to step S1002, and in step S1002, the history management unit 684 relates to the synchronization process received from the projector device 530. Information (such as the terminal IDs of the projector device 530 and the history management server 560 of the synchronization destination) is stored in the metadata history management DB, the process is looped to step S1001, and the system waits for next notification of the synchronization information.

  Hereinafter, a case where a search is performed from the operation terminal 520 will be described with reference to FIG. 28 again. The search request unit 652 of the operation terminal 520 issues a search query to the history search unit 650 of the projector device 530 and receives and displays the search result. The history search unit 650 of the projector device 530 responds to the search request instructed from the search request unit 652 of the operation terminal 520, and the information in the metadata in the metadata storage unit and the stored content management table in the content storage unit. To retrieve information corresponding to the search query and return it as a search result. Further, in the present embodiment, the history search unit 650 transmits / receives the usage history information that has been already synchronized with the history management server 560 by the data synchronization unit 654 and deleted from its own metadata storage unit and content storage unit. A query is sent to the history management unit 684 of the remote communication management server 580 via 670 to make an inquiry.

  When the history management unit 684 receives an inquiry from the projector device 530, the history management unit 684 uses the terminal ID of the projector device 530 as a key (or, if the search query includes a condition for the content attribute as a key), metadata The history management table is searched to find the history management server 560 that holds the usage history information of the projector device 530 (or the corresponding information if the search query includes a condition for the content attribute). When the corresponding history management server 560 is found, the history management unit 684 transmits a search query to the history management server 560 and receives the search result. The history management server 560 searches its own metadata history DB 562 and content history database 564 with the passed search query, and transmits the search result to the remote communication management server 580.

  FIG. 32 is a flowchart illustrating search processing executed between the projector device, the remote communication management server, and the history management server according to the fourth embodiment. The search process shown in FIG. 32 is started from step S1100. In step S1101, the operation terminal 520 creates a search query for the history information of the metadata according to the input from the user. In step S1102, the search query is sent to the projector device 530. Send. This search query includes search conditions for user identification values, content attributes, time, and the like.

  When the projector device 530 receives the search query in step S1103, it determines in step S1104 whether the metadata corresponding to the search query exists in its own metadata storage unit. If it is determined in step S1104 that the metadata does not exist (NO), the process branches to step S1105. In step S 1105, projector device 530 sends a search query to remote communication management server 580 to inquire about metadata.

  In step S1106, remote communication management server 580 uses the terminal ID of projector device 530 as the inquiry source (or the conference identification value if the search query includes designation of the conference identification value of the content attribute) as a search key. The metadata history management table 750 is searched. In step S1107, it is determined whether or not metadata corresponding to the search result exists on the specific history management server 560. If it is determined in step S1107 that there is no metadata corresponding to the search result on all managed history management servers 560 (NO), that fact is returned to the projector device 530 as a result of the inquiry. On the other hand, if it is determined in step S1107 that a search result exists on the specific history management server 560 (YES), the search query is passed to the specified history management server 560, and the history management server 560 is determined in step S1108. Searches the metadata DB 562 for metadata corresponding to the passed search query.

  When the history management server 560 finds a corresponding series of metadata (for example, a series of metadata having a predetermined conference identification value), the history management server 560 transmits the search result to the remote communication management server 580 in step S1109. In step S1110, the remote communication management server 580 receives the search result from the history management server 560, and transfers the search result to the projector device 530 as a result of the inquiry in step S1111. In step S1112, the projector device 530 determines whether or not there is a search result including the corresponding series of metadata as a result of the inquiry. If there is no search result (NO), the projector terminal 530 notifies the operation terminal. It returns to 520 as a search result. On the other hand, if it is determined in step S1112 that there is a search result including the corresponding series of metadata (YES), the projector device 530 acquires the corresponding series of metadata in step S1113, In step S1114, a series of metadata is transmitted to the operation terminal 520. If it is determined in step S1104 that the metadata exists in itself (YES), the process branches to step S1113 to acquire a corresponding series of metadata. In step S1114, the series of operations is performed to the operation terminal 520. Send metadata.

  In step S1115, the operation terminal 520 receives the search result from the projector device 530, and when it includes a series of metadata corresponding to the search query, in step S1116, copies the content using the searched metadata. In step S1117, the process is terminated. The series of metadata included in the search result can be used as it is for reproduction of the content as it is, or can be reused with some modifications.

  FIG. 33 illustrates an operation screen for reusing contents displayed on the display screen of the operation terminal 520 of the present embodiment. The operation screen 820 shown in FIG. 33 includes a pull-down menu 822 for changing the screen layout setting, and an entire area 830 representing the entire output content display area. The entire area 830 is divided into two left and right screen areas 832 and 840 in the example shown in FIG. Also, the operation screen 820 shown in FIG. 33 includes a content progress bar 850 for selecting content at an arbitrary timing by moving the knob 852. By operating the content progress bar 850, the state of the output content at an arbitrary timing is displayed, and the allocation position and size of an object (such as the camera display area 384) in the content are changed, deleted, text added, It is possible to insert metadata such as deletion and modify the output content.

  Furthermore, on the operation screen 820 shown in FIG. 33, when an arbitrary timing drags and drops a sub-content or a sub-content shortcut as shown by a cursor 842 in FIG. Metadata specifying the URL of the sub-content can be inserted into a series of copied metadata, and the output content can be modified.

  According to the fourth embodiment described above, for example, when there is a request to reuse output content used in a previous specific meeting, a meeting identification value and date / time for identifying the meeting are designated, A series of metadata related to a specific meeting can be searched across the history management server 560, and existing contents can be reused efficiently.

  As described above, according to the above-described embodiment, it is possible to grasp the usage status of the video output device including the content of the output content to be output, and the usage history is tracked or reused later. A video output device capable of executing the video output method, a video output method executed by the video output device, and a program for realizing the video output device can be provided.

  In the above-described embodiments, the projector device has been described as an example of the video output device. However, the video output device is not limited to this, and a display device such as a plasma display, a liquid crystal display, or a rear projection display is used. In addition, it can be configured as various devices that output video.

  The above functions can be realized by computer-executable programs written in legacy programming languages such as assembler, C, C ++, C #, Java (registered trademark), object-oriented programming languages, etc. ROM, EEPROM, EPROM, It can be stored in a device-readable recording medium such as flash memory, flexible disk, CD-ROM, CD-RW, DVD, SD card, MO, and distributed.

  Although the embodiments of the present invention have been described so far, the embodiments of the present invention are not limited to the above-described embodiments, and those skilled in the art may conceive other embodiments, additions, modifications, deletions, and the like. It can be changed within the range that can be done, and any embodiment is included in the scope of the present invention as long as the effects of the present invention are exhibited.

12 ... CPU, 14 ... ROM, 16 ... RAM, 18 ... SSD, 20 ... media drive, 22 ... recording media, 24 ... operation buttons, 26 ... power switch, 30 ... bus line, 32 ... network I / F, 34 ... Image sensor I / F, 36 ... CCD camera, 38 ... Audio input / output I / F, 40 ... Microphone, 42 ... Speaker, 44 ... Display I / F, 52 ... CPU, 54 ... ROM, 56 ... RAM, 58 ... HDD , 60 ... HD, 62 ... display, 64 ... bus line, 66 ... network I / F, 68 ... keyboard, 70 ... mouse, 72 ... media drive, 76 ... CD-ROM drive, 78 ... CD-ROM, 100,500 ... Video output system, 110, 510 ... Network, 112, 512 ... LAN, 114, 514 ... Dedicated line, 11 , 516 ... Internet, 120, 520 ... Operation terminal, 122, 522 ... Microphone, 124, 524 ... Web camera, 126 ... Mouse, 130, 530 ... Projector device, 140, 540 ... Content management server, 142, 542 ... Content Database, 154, 554 ... Router, 160, 580 ... Remote communication management server, 162, 582 ... Relay server, 164, 584 ... Program providing server, 170, 570 ... Remote communication terminal, 172, 572 ... Display, 202, 602 ... Content display operation unit, 204, 604 ... microphone audio distribution unit, 206, 606 ... camera video distribution unit, 208, 608 ... content distribution unit, 210, 610 ... control unit, 220, 620 ... network I / F, 222, 622 ... metadata reception Analysis unit, 224, 624 ... content acquisition unit, 226, 626 ... output content generation unit, 228, 628 ... conversion module, 230, 630 ... content synthesis unit, 232, 632 ... history recording unit, 234, 634 ... metadata Storage unit, 236, 636 ... Content storage unit, 240, 660 ... Video display unit, 242 ... Graphic controller, 244 ... VRAM, 246 ... DAC, 248 ... Video display device, 250 ... Transmission / reception unit, 251 ... Audio input unit, 252 ... voice output part, 253 ... operation input receiving part, 254 ... login request part, 255 ... imaging part, 256 ... image display control part, 257 ... storage / read processing part, 258 ... storage part, 259 ... delay detection part, 260 ... final narrowing down part, 261 ... measuring part, 262 ... calculation part, 263 ... final selection part, 264 ... state detection 270 ... Transmission / reception part, 271 ... Status detection part, 272 ... Data quality confirmation part, 273 ... Change quality management part, 274 ... Data quality change part, 275 ... Storage / read processing part, 276 ... Nonvolatile storage part, 280 Transmission / reception unit 281 Terminal authentication unit 282 State management unit 283 Terminal extraction unit 284 Session management unit 285 Quality determination unit 286 Storage / reading processing unit 287 Non-volatile storage unit 288 ... delay time management part, 289 ... terminal state acquisition part, 290 ... primary narrowing down part, 291 ... selection session ID generation part, 292 ... terminal IP address extraction part, 293 ... priority determination part, 294 ... primary selection part, 300 ... Operation screen, 302 ... Pull-down menu, 304 ... Button, 306 ... Button, 310 ... Whole area, 312, 314 ... Screen area, 316 ... Camera display area, 18 ... pointer graphic, 320, 340, 360, 800, 810 ... projection screen, 322, 324, 326, 342, 344, 346, 348, 362, 364, 366, 368, 802, 804, 806, 812, 814 816 ... Projection screen area, 400, 720 ... Series of metadata, 410 ... Output content generation rules, 420, 730 ... Accumulated content management table, 550 ... Projector management server, 552 ... Conversion module, 560 ... History management server, 562 ... Metadata history database, 564 ... content history database, 638 ... conversion module calling unit, 640 ... user identification unit, 642 ... conversion module management unit, 644 ... management unit, 646 ... conversion module, 648 ... conversion module providing unit, 650 ... history search part, 652 ... Search request unit, 654 ... Data synchronization unit, 656 ... Synchronization management unit, 670,682 ... Transmission / reception unit, 672 ... Login request unit, 674,686 ... Storage / read processing unit, 676,688 ... Storage unit, 678 ... Status detection 680 ... history search unit, 684 ... history management unit, 700 ... user rule, 710 ... user data, 740 ... accumulated content management table, 750 ... metadata history management table, 820 ... operation screen, 822 ... pull-down menu 830 ... Overall area, 832,840 ... Screen area, 834 ... Camera display area, 842 ... Cursor, 850 ... Progress bar, 852 ... Knob, A ... Region, B ... Region

JP 2008-227726 A JP 2008-224869A JP 2008-224867 A JP 2007-295127 A

Claims (31)

A video output device connected to a network,
Receiving means for receiving metadata transmitted from the terminal device and describing the configuration of the output content to be output;
Obtaining means for obtaining sub-contents constituting the output content based on the metadata via the network;
An output means for outputting the output content including the plurality of sub-contents to be acquired;
History recording means for creating video data of the output content that has been video output in accordance with conditions that define a start point and an end point of recording, and recording the generated video data as a usage history of the video output device; A video output device characterized by that. Analyzing means for analyzing the received metadata, and obtaining information indicating the sub-content constituting the output content and information indicating a layout of the sub-content included in the metadata ;
The apparatus according to claim 1, further comprising: a generating unit configured to combine the plurality of sub contents acquired based on the information indicating the sub contents according to the information indicating the layout, and generate the output content. The video output device described.   3. The video according to claim 1, wherein the history recording unit further accumulates information including the metadata related to the output content output as a video as a usage history of the video output device. 4. Output device. The use history stored in the video output device, and sends the history management server device that manages the usage history of the video output apparatus further includes synchronization means for performing data synchronization, any one of claims 1 to 3 The video output device described in 1. The synchronization means includes an identification value for identifying the video output apparatus and an identification value for identifying the synchronization history management server apparatus for a remote communication management server that manages remote communication during the data synchronization. The video output device according to claim 4 , wherein synchronization information is transmitted to cause the remote communication management server to manage synchronization of the video output device. If the usage history corresponding to the search query is not found even after searching the accumulated usage history, the remote query management server is inquired of the search result across the history management server device by passing the search query. The video output device according to claim 5 , further comprising search means. The metadata, the address indicating the storage location of the sub content, the is information including at least one of the layout of screen split and the sub-content of the sub content, according to any one of claims 1 to 6 Video output device. The state detection means for detecting the operation state including the power supply state and the image output state of the video output device, and the remote communication management server for managing the remote communication, the detected operation state is transmitted to the remote communication management further comprising a transmission means for managing the operating state of the video output device to the server, the video output device according to any one of claims 1-7. A log-in request means for requesting log-in processing to a remote communication management server that manages remote communication, and reception of video data or audio data as a sub-content via a relay server managed by the remote communication management server and means, video output device according to any one of claims 1-8. The system further comprises user identification means for identifying a user of the video output device, wherein a condition for defining a layout change when generating the output content is changed corresponding to the identified user. The video output device according to any one of 1 to 9 . The sub-content, document data, text data, still image data, moving image data, comprising at least one of audio data and graphic data, a video output device according to any one of claims 1-10.   The generation means includes a conversion module for using the sub-content corresponding to the format of the sub-content, and the video output device is a management means for managing the usable conversion module, and Further comprising the management means for communicating with a server device that manages the use of the conversion module and performing the procedure for making the required conversion module available when the conversion module to be used is not available. The video output device according to claim 2. The generating unit includes a synthesizing unit that allocates the sub-contents provided as document data, text data, graphic data, moving image data, or audio data according to the acquired information indicating the layout , and synthesizes the output content. The video output device according to claim 2. The video output device is a projector device, a video output device according to any one of claims 1 to 13. A video output system including a terminal device and a video output device connected to a network, wherein the terminal device includes transmission means for transmitting metadata describing a configuration of output content to be output via the network, The video output device
Receiving means for receiving the metadata via the network;
Obtaining means for obtaining sub-contents constituting the output content based on the metadata via the network;
An output means for outputting the output content including the plurality of sub-contents to be acquired;
A history recording unit that creates video data of the output content that has been video output in accordance with a condition that defines a recording start point and an end point , and records the generated video data as a usage history of the video output device; A video output system characterized by The video output device
Analyzing means for analyzing the received metadata, and obtaining information indicating the sub-content constituting the output content and information indicating a layout of the sub-content included in the metadata ;
16. The generating apparatus according to claim 15 , further comprising: generating means for generating the output content by combining a plurality of the sub-contents acquired based on the information indicating the sub-contents according to the information indicating the layout. The video output system described. The terminal device transmits a video data or audio data to a remote communication management server that manages remote communication via a login request means for requesting a login process and a relay server managed by the remote communication management server. The video output system according to claim 16 , further comprising: means. The video output system further includes a remote communication management server for managing remote communication, the remote communication management server including history management means for recording synchronization information received from the video output device in a history management database. ,
The video output device transmits the usage history stored in the video output device to a history management server device that manages the usage history of the video output device, performs data synchronization, and transmits the usage history to the remote communication management server. 18. The video output system according to claim 16 or 17 , further comprising synchronization means for transmitting synchronization information including an identification value for identifying a video output device and an identification value for identifying a history management server device as a synchronization destination. The video output device passes the search query to the remote communication management server when the usage history corresponding to the search query is not found even after searching the accumulated usage history, and extends over the history management server device. It further includes a search means for inquiring search results,
In response to the inquiry from the video output device, the history management means of the remote communication management server specifies a history management server of the synchronization destination of the video output device from the history management database, and specifies the specified synchronization destination The video output system according to claim 18 , wherein a search query is passed to a history management server to obtain a search result across the history management server device. The video output system is a remote communication management server that manages remote communication, and receives an operation state notified from the video output device and records an operation state of the video output device, and the video output Including a transmission means for transmitting the operating state of the video output device to a remote communication terminal having the device as a remote communication destination terminal, including the remote communication management server,
The video output device transmits the detected operation state to a state detection unit that detects an operation state including a power supply state and a video output state of the video output device, and a remote communication management server that manages remote communication. Te, further comprising, a video output system according to claim 16 or 17 and a transmitting means for managing the operating state of the video output device to the remote communication management server. A video output method executed by a video output device connected to a network,
Receiving metadata that is transmitted from the terminal device and describes a configuration of output content to be output; and
Starting acquisition of sub-contents constituting the output content based on the metadata via the network;
Starting video output of the output content including the plurality of acquired sub-contents;
A step of moving image data of the output content with video output, created according to the conditions defining the start and end points of the recording, recording the video data created as the utilization history of the video output device,
Including video output method. Analyzing the received metadata and obtaining information indicating the sub-contents constituting the output content and information indicating the layout of the sub-contents included in the metadata ;
The video output method according to claim 21 , further comprising: combining the plurality of sub contents acquired based on the information indicating the sub contents according to the information indicating the layout to generate the output contents. The information including the received the metadata, further further comprising the step of storing a usage history of the video output device, video output method according to claim 21 or 22. The metadata, the address indicating the storage location of the sub content, the is information including at least one of the layout of screen split and the sub-content of the sub content, according to any one of claims 21 to 23 Video output method. Further comprising identifying a user of the video output device, a condition which defines the layout change in generating the output content, and changing in response to identified the user, according to claim 21 25. The video output method according to any one of 24 to 24 . Determining whether a conversion module required for converting the sub-content to be included in the output content is available;
If the required conversion module is not available, communicating with a server device that manages the use of the conversion module, and performing a procedure to make the required conversion module available;
The video output method according to any one of claims 21 to 25 , further comprising: calling the required conversion module made available to generate the output content. 27. The method according to any one of claims 21 to 26 , further comprising a step of transmitting the usage history accumulated in the video output device to a history management server device that manages a usage history of the video output device and performing data synchronization. The video output method described. The step of performing the data synchronization includes an identification value for identifying the video output device and a history management server device of the synchronization destination so that the remote communication management server managing remote communication manages the synchronization of the video output device. The video output method according to claim 27 , further comprising a sub-step of transmitting synchronization information including an identification value for identifying In response to the search query, searching the accumulated usage history, and when the usage history corresponding to the search query is not found, the search query is passed to the remote communication management server and the history management server The video output method according to claim 28 , further comprising the step of inquiring a search result across the devices. Detecting the operation state including the power supply state and the video output state of the video output device; and causing the remote communication management server managing remote communication to manage the operation state of the video output device. 30. The video output method according to any one of claims 21 to 29 , further comprising a step of transmitting an operation state. A program for realizing a video output device connected to a network, comprising:
Receiving means for receiving metadata transmitted from the terminal device and describing the configuration of the output content to be output;
Obtaining means for obtaining, via a network, sub-contents constituting the output content based on the metadata;
A plurality of said output means to said output content to a video output containing the sub-content to be acquired, and the moving image data of the output content with video output, created according to the conditions defining the start and end points of recording, creating History recording means for recording the moving image data as usage history of the video output device
Program to function as .