JP2010244561A - Image transmitting apparatus, display system, image transmission program, and recording medium - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an image transmitting apparatus capable of setting a configuration of a display image, to provide a display system, and to provide an image transmission program and recording medium. <P>SOLUTION: The image transmitting apparatus transmits image data of the image displayed on a display device. The apparatus includes: a selection unit (image selection unit 46 and figure drawing unit 47) for selecting an object constituting the display image; a data generation unit 54 for generating the data for transmission being the image data of the display image on the basis of the image data of the selected object; and a data transmission unit 55 for transmitting the generated data for transmission to the display device. According to this arrangement, the image data of the display image constituted by the image of the selected object is transmitted to the display device, thereby preventing an unnecessary image from being displayed on the display device. <P>COPYRIGHT: (C)2011,JPO&INPIT

Description

  The present invention records an image transmission device that transmits image data to a display device, a display system that includes the image transmission device and the display device, an image transmission program that is executed by the image transmission device, and the image transmission program. The present invention relates to a recording medium.

  2. Description of the Related Art Conventionally, a display system including an image transmission device that transmits image data and an image display device that displays an image corresponding to the image data is known. As such a display system, a projector system in which a PC (Personal Computer) as an image transmission apparatus and a projector as an image display apparatus are connected via a USB (Universal Serial Bus) cable is known (for example, a patent) Reference 1).

  In the projector system described in Patent Document 1, image data generated by a PC is transmitted to a projector via a USB cable, and the projector displays an image corresponding to the acquired image data on a projection surface such as a screen. Formed and displayed. Since such a projector can display a relatively large image with one projector, a projector system having the projector is often used for presentations in a company, home theaters, and the like.

JP 2004-69996 A

  However, in the projector system described in Patent Document 1, the image data transmitted from the PC to the projector is image data related to the operating screen of the PC. That is, the image data may include image data related to an OS (Operation System) desktop in addition to image data related to a screen during execution of a predetermined application executed on the PC. For this reason, image data including images set as desktop wallpaper and images of notepads that are activated to create minutes, such as images that the PC user does not want to show to others is sent to the projector. Therefore, there is a problem that the image is displayed by the projector. For this reason, there has been a demand for a configuration in which an image to be displayed on a projector can be set on the side of an image transmission apparatus such as a PC.

  An object of the present invention is to provide an image transmission device, a display system, an image transmission program, and a recording medium that can set the configuration of a display image.

  In order to achieve the above-described object, an image transmission device of the present invention is an image transmission device that transmits image data of a display image to be displayed on a display device, and a selection unit that selects an object constituting the display image; A data generation unit that generates transmission data to be image data of the display image based on the image data of the selected object, and a data transmission unit that transmits the generated transmission data to the display device It is characterized by providing.

Here, for example, when the image transmission apparatus is configured by a PC, the object is a still image and a moving image stored in a storage unit such as an HDD (Hard Disk Drive) provided in the PC, and is being executed. This is a general term indicating applications, character strings, graphics, and the like.
The display device is a display device connected to the image transmission device, and can be exemplified by the projector described above.

  According to the present invention, the image data of the display image is generated based on the image data of the object selected by the selection unit, and the image data is transmitted to the display device. That is, the image data of the display image transmitted to the display device is based on the image data of the object selected by the selection unit. According to this, the user of the image transmission device can set the configuration of the display image. Therefore, unnecessary image data, for example, image data of an image that the user of the image transmission device does not want to show to others is transmitted to the display device, and the image that is not desired to be displayed is prevented from being displayed on the display device. Can do.

In the present invention, a layout setting unit that sets a layout in the display image of the image of the object selected by the selection unit, the data generation unit, based on the layout set by the layout setting unit, Preferably, the transmission data is generated.
According to this, since the layout (for example, display position and size) of the object image in the display image can be set, the object image is displayed at the desired position in the display image in the desired size. be able to. In addition, when a plurality of objects are selected, the images of these objects can be arranged and displayed so that at least a part of the images of the objects overlap each other. Accordingly, it is possible to improve the degree of freedom in setting the display image displayed by the display device.

  In the present invention, a display size acquisition unit that acquires a display size of an image that can be displayed by the display device, a layout region formation unit that forms a layout region according to the acquired display size, and the selection unit are selected. An image arrangement unit that arranges an image image corresponding to the object in the layout area, and the layout setting unit corresponds to the image image according to the image image set in the layout area. It is preferable to set the layout of the object.

  According to the present invention, the layout of the object image in the display image can be set by setting the layout of the image image for the layout area formed according to the display size of the display device by the layout area forming unit. Therefore, since the setting state of the display image can be visually determined, the display image can be easily set.

  In the present invention, a hierarchy setting unit that sets a hierarchy indicating a position from the back of the object is provided, and the data generation unit is configured to perform the transmission in order from the object set in the hierarchy setting unit in the lowest order. It is preferable to generate data.

Here, when the objects are arranged so that some of them overlap each other, one object is arranged on the back side and the other object is arranged on the front side. In such a case, if the image of the object on the front side is updated first and the image of the object on the back side is updated later, the context of the images of the objects in the display image is broken.
On the other hand, in the present invention, by generating the transmission data in order from the object having the lower hierarchy, that is, the object on the back side, the image of the object on the back side is updated first, and the image of the object on the front side is changed later. Since it is updated, in the display image, the image of the object on the back side can be located on the back side, and the image of the object on the front side can be located on the front side. Therefore, it is possible to reliably display a display image based on the set layout.

In the present invention, it is preferable that the data transmission unit transmits the transmission data generated for each object by the data generation unit.
According to the present invention, when objects are arranged so as not to overlap with each other, image data such as a still image that does not need to be updated is not transmitted to the display device, and a moving image that needs to be updated. The image data such as can be set to be sequentially transmitted to the display device. Accordingly, the amount of data transmitted to the display device can be reduced.

Or in this invention, it is preferable that the said data transmission part transmits the said data for transmission produced | generated for every screen of the said display image by the said data generation part.
Here, when objects are arranged so as to overlap each other, when transmission data including image data of the object is transmitted for each object, the image of the object on the back side is displayed in the display image. The image of the object on the front side is displayed. For this reason, the timing at which a display image in which the context of each object is not appropriate is displayed.
On the other hand, in the present invention, after image data for one screen is generated, transmission data based on the image data for one screen is transmitted, so that such inconvenience can be prevented. Accordingly, it is possible to appropriately display a display image according to the set layout.

  In the present invention, the data generation unit converts the newly generated image data for one screen into image data for the one screen generated before the newly generated image data for one screen. When the change determination unit and the change determination unit determine that there has been a change, the previously generated image data for one screen is generated before the change determination unit. It is preferable to include a difference acquisition unit that acquires difference image data that is a difference from the image data for one screen, and a transmission data generation unit that generates the transmission data based on the difference image data.

  According to the present invention, the transmission data transmitted to the display device includes a difference between the newly generated image data for one screen and the image data for one screen generated before the image data. Difference image data is included. According to this, since image data for one screen is not sequentially transmitted to the display device, the amount of data transmitted to the display device can be reduced.

In the present invention, when the image formed by the difference image data is not rectangular, the transmission data generation unit divides the difference image data and generates a plurality of rectangular image data in which the formed image is rectangular. Preferably, the transmission data is generated based on the rectangular image data.
According to the present invention, the transmission data transmitted to each display device includes rectangular image data forming a rectangular image. Therefore, when the display device generates a display image, the display image currently being displayed is displayed. It is possible to easily combine the rectangular image data that is the updated image data with the image data. Therefore, the burden of image display processing in the display device can be reduced, and the display image can be appropriately displayed.

  Alternatively, in the present invention, when the image formed by the difference image data is not rectangular, the transmission data generation unit adds an area that is not displayed on the display device, and the formed image becomes rectangular. It is preferable that rectangular image data is generated and the transmission data is generated based on the rectangular image data.

Here, when the image of the difference image data is not rectangular, the image is divided into a plurality of rectangular images, and each of the transmission data including the image data of the divided rectangular images is generated. This increases the burden of the transmission data generation process. In addition, since header information indicating the position of the image on the display device is included in each transmission data, the amount of data transmitted to the display device may increase.
On the other hand, in the present invention, since the area that is not displayed on the display device is added to the difference image, the transmission data is generated based on the rectangular image data generated so that the formed image is rectangular. It is sufficient to generate one transmission data for one change area, and the amount of data transmitted to the display device can be reduced. In addition, the display device can appropriately display the display image by updating the display image so that the additional area is not displayed.

According to another aspect of the present invention, there is provided a display system including the above-described image transmission device and a display device that displays a display image based on image data transmitted from the image transmission device.
According to the present invention, it is possible to achieve the same effect as that of the above-described image transmission apparatus, thereby improving the versatility of the display system.

The image transmission program of the present invention is an image transmission program executed by an image transmission device that transmits image data of a display image to be displayed on a display device, and can be displayed on the image transmission device by the display device. A display size acquisition step of acquiring a display size of a simple image, a layout region formation step of forming a layout region according to the acquired display size, a selection step of selecting an object to be included in the display image, and the selection step An image placement step of placing an image image corresponding to the object selected in step S in the layout area, and an image of the object corresponding to the image image in accordance with the image image placed in the layout area. A layout setting section for setting a layout in the display image; And a hierarchy setting step for setting a hierarchy indicating the position from the back of the object, and among the image data of the selected object, the objects set in the hierarchy setting step in order from the object having the lowest hierarchy A data generation step of generating transmission data to be image data of the display image based on the layout; and a data transmission step of transmitting the generated transmission data to the display device. Features.
According to the present invention, when the image transmission apparatus executes the image transmission program, the same effects as those of the above-described image transmission apparatus can be obtained.

The recording medium of the present invention is characterized in that the above-described image transmission program is recorded so as to be readable by a computer.
According to the present invention, the image transmission apparatus reads and executes an image transmission program recorded on a recording medium in a computer-readable manner, so that the same effect as that of the above-described image transmission apparatus, that is, a display image displayed on the display apparatus Can be set. As recording media, magnetic tapes such as DAT (Digital Audio Tape), magnetic disks such as FD (Flexible Disc), optical disks such as CD (Compact Disc) and DVD (Digital Versatile Disc), magneto-optical disks, hard disk devices, In addition, a semiconductor memory or the like can be used, and by using these, the image transmission program can be installed and executed by the image transmission apparatus, and the image transmission program can be easily distributed.

1 is a block diagram showing a configuration of a display system according to a first embodiment of the present invention. The figure which shows an example of the operation | movement image in the said embodiment. The figure which shows the screen at the time of execution of the image transmission application in the said embodiment. The figure which shows the character input area in the said embodiment. The block diagram which shows the structure of the image transmission application execution part in the said embodiment. The flowchart which shows the image transmission application execution time process in the said embodiment. The flowchart which shows the transmission target setting process in the said embodiment. The flowchart which shows the setting information acquisition process in the said embodiment. The flowchart which shows the data transmission process in the said embodiment. The flowchart which shows the data transmission process in the said embodiment. The flowchart which shows the packet transmission process in the said embodiment. The figure which shows the display image displayed with the transmission destination apparatus in the said embodiment. The block diagram which shows the image transmission application execution part which comprises PC of the display system which concerns on 2nd Embodiment of this invention. The figure which shows an example of the image data contained in the packet in the said embodiment. The flowchart which shows the image transmission application execution time process in the said embodiment. The flowchart which shows the setting information acquisition process in the said embodiment. The flowchart which shows the data transmission process in the said embodiment. The flowchart which shows the image generation process in the said embodiment. The figure which shows an example of the image data contained in the packet which PC of the display system which concerns on 3rd Embodiment of this invention produces | generates.

[1. First Embodiment]
Hereinafter, a first embodiment of the present invention will be described with reference to the drawings.
[Configuration of display system]
FIG. 1 is a block diagram showing a configuration of a display system 1 according to the present embodiment.
As shown in FIG. 1, the display system 1 of the present embodiment includes a projector 2 as a display device and a notebook PC as an image transmission device that transmits image data of a display image to be displayed on an external device such as the projector 2. (Personal Computer; hereinafter abbreviated as “PC”) 3. In the present embodiment, the projector 2 and the PC 3 are connected via a LAN (Local Area Network), but may be connected via a USB (Universal Serial Bus) or the like.

[Configuration of projector]
The projector 2 displays a display image corresponding to the image data included in the packet received from the PC 3. Specifically, the projector 2 modulates the light beam emitted from the light source, forms image light according to the image data, and enlarges and projects the image light on a projection surface such as a screen, thereby displaying a display image. Is displayed on the projection surface. Such a projector 2 includes image display means 21 and control means 22.

The image display means 21 is driven according to a drive signal input from the control means 22 to form and project the above-described image light. The image display means 21 includes a light source device 211, a light modulation device 212 that modulates light emitted from the light source device 211 to form image light, and a projection optical device 213 that projects the image light. Yes.
Among these, the light modulation device 212 includes a liquid crystal panel in which a liquid crystal as an electro-optical material is hermetically sealed in a pair of transparent glass substrates, and the liquid crystal panel receives a drive signal input from the control unit 22. Accordingly, the alignment state of the liquid crystal is controlled to modulate the polarization direction of the incident light beam.

  The control means 22 is configured as a circuit board on which a CPU (Central Processing Unit) and the like are mounted, and controls the driving of the projector 2 as a whole. For example, the control unit 22 processes a packet received from the PC 3 and outputs a drive signal to the image display unit 21 in order to form a display image corresponding to the packet. Such a control unit 22 includes a communication connection unit 221, a data reception unit 222, a packet analysis unit 223, an image development unit 224, an image memory 225, and a panel driver 226.

The communication connection unit 221 establishes a communication connection with a connected external device (for example, the PC 3). At this time, in response to a request from the connected external device, the communication connection unit 221 transmits the image size (resolution and image display size) that can be formed by the light modulation device 212 to the external device. .
The data receiving unit 222 acquires a packet input from the PC 3.
The packet analysis unit 223 processes the acquired packet and acquires header information and image data from the packet.

The image expansion unit 224 expands the acquired image data in an image memory 225 configured by a VRAM (Video Random Access Memory). At this time, the image expansion unit 224 combines the acquired image data with the image data expanded in the image memory 225 based on the position information and size information of the image data included in the acquired header information. Image data for the screen is generated.
The panel driver 226 outputs a drive signal to the light modulation device 212 based on the image data developed in the image memory 225, and causes the light modulation device 212 to form an image corresponding to the image data.

[Configuration of PC]
The PC 3 is configured by a general PC, and stores programs stored in a storage unit 32 such as an HDD (Hard Disk Drive) in accordance with a user input operation to the operation unit 31 including a mouse and a keyboard. Read and execute a predetermined process (for example, application). In response to the input operation, the PC 3 reads an image transmission program stored in the storage unit 32, executes an image transmission application (hereinafter may be abbreviated as “image transmission application”), and executes an external device ( For example, the image data (packet) of the display image displayed on the projector 2) is generated and transmitted. Such a PC 3 includes an image display means 33, an operation image generation means 34, a drawing memory 35, a frame memory 36, and a control means 37 in addition to the operation means 31 and the storage means 32.

Among these, the drawing memory 35 is composed of a video memory, and is used for image data generation by the motion image generation means 34.
The frame memory 36 is used when an image transmission application is executed by an image transmission application execution unit 4 (to be described later) of the control unit 37, and for example, various image data for one frame formed on the drawing memory 35. Used for copying, etc.

  The image display means 33 is composed of a liquid crystal panel integrally attached to the PC 3 and displays an image corresponding to a drive signal input from the operation image generation means 34. Such an image is an operation image indicating the operation state of the PC 3, and includes an image of a runtime screen when the image transfer application is activated. In the present embodiment, since the PC 3 is a notebook PC, the image display means 33 is integrally attached to the PC 3. However, the image display means 33 includes a display connected to the PC 3 via a cable or the like. Also good.

  The operation image generation means 34 is composed of a graphics chip, and under the control of the control means 37, draws the image data of the operation image of the PC 3 and the run-time image of the application being executed by the control means 37. Form on top. Then, the motion image generation means 34 outputs a drive signal corresponding to the image data of the motion image formed on the drawing memory 35 to the image display means 33 and causes the image display means 33 to display the motion image.

FIG. 2 is a diagram illustrating an example of an operation image. Specifically, FIG. 2 is a diagram illustrating an example of an operation image in which a plurality of applications including an image transfer application are executed.
For example, the operation image generation unit 34 may generate an operation image AP such as that shown in FIG. 2 when a plurality of applications (application A, application B, notepad, and image transfer application) are being executed by the control unit 37. Generate image data. This action image AP is composed of an execution application display area AP1 indicating the type of application being executed, and a work area AP2 in which a window (frame) of each application is displayed.

  Among these, in the work area AP2, when the window of the application being executed is not in a state of being displayed on the full screen (a state in which all of the work area AP2 is covered with one window), as shown in FIG. The windows W (W1 to W4) of the application being executed and the icons IC (IC1 to IC3) of the files arranged on the work area AP2 are displayed. In such work area AP2, the arrangement positions and sizes of the windows W1 to W4 can be adjusted by a predetermined operation (for example, a drag operation with a mouse). For this reason, in FIG. 2, each window W and icon IC are displayed so as not to overlap each other, but they may overlap each other. In FIG. 2, among the applications currently being executed (application A, application B, notepad, and image transmission application), the window of the image transmission application is in an active state (operable).

Returning to FIG. 1, the control means 37 is configured by a CPU (Central Processing Unit) or the like, and controls the entire PC 3 by starting up an OS (Operation System). Such a control unit 37 includes a communication connection unit 371, an application execution unit 372, and an image transmission application execution unit 4.
The communication connection unit 371 establishes a communication connection with an external device (for example, the projector 2) connected to the PC 3. Specifically, the communication connection unit 371 includes an external device corresponding to an IP (Internet Protocol) address and a channel specified by the user, and an external device directly connected to the PC 3 via a USB (Universal Serial Bus) cable. Establish a communication connection for.
The application execution unit 372 reads out a program stored in the storage unit 32 in response to a user input operation on the operation unit 31, and an application corresponding to the program (for example, the above-described application A, application B, and memo pad). And an application other than the image transmission application).

  The image transmission application execution unit 4 reads the image transmission program stored in the storage unit 32 and executes the image transmission application. Specifically, the image transmission application execution unit 4 is an image corresponding to a user's input operation on the execution screen of the image transmission application displayed in the window W4 (FIGS. 2 and 3) on the work area AP2. Data is generated, and a packet (data for transmission) generated based on the image data is transmitted to the projector 2.

FIG. 3 is an enlarged view showing a screen during execution of the image transmission application.
Here, a runtime screen displayed when the image transmission application is executed will be described.
An execution screen of the image transmission application is formed and displayed in the window W4 by the operation image generation unit 34 described above. As shown in FIG. 3, the runtime screen includes a first operation area A1, a second operation area A2, and a work area A3.

In the first operation area A1, six keys K1 to K6 respectively labeled “background”, “still image”, “moving image”, “application”, “text”, and “graphic drawing” are arranged. .
In the second operation area A2, a “transmission start” key K7 and a “transmission end” key K8, and a list L capable of selecting an external device connected to the PC 3 are arranged. In the present embodiment, the IP address of the external device is cited as the display item of the list L, but it may be a number set for the external device, a character string indicating the device type, or the like.
In the work area A3, a layout area RA in which the image size (image display size) that can be displayed by the external device selected in the list L is reduced is arranged.

In such a runtime screen, when an external device (transmission destination device) that is a transmission destination of image data is selected from the list L arranged in the second operation area A2, a layout area RA is displayed in the work area A3. The In this state, by inputting the keys K1 to K6, the background image of the layout area RA can be set and the objects can be arranged in the layout area RA.
In the present embodiment, an object refers to a still image, a moving image, an application runtime screen, text, and a figure.

Specifically, when the “background” key K1 is input, a dialog for selecting a still image file is displayed, and the selected image file is set as a background image in the layout area RA.
When the “still image” key K2 is input, a dialog for selecting a still image file is displayed. When the “moving image” key K3 is input, a dialog for selecting a moving image file is displayed. Then, thumbnails of the image files selected in these dialogs are arranged as image images in the layout area RA.
When the “App” key K4 is input, a list for selecting an application other than the image transfer application among the running applications is displayed, and an image image of the selected application (for example, an application runtime screen is expanded or contracted). Image) is arranged in the layout area RA.
The position and size of these image images can be adjusted by an input operation (for example, a drag operation) on the operation means 31 in the layout area RA.

FIG. 4 is a diagram showing the character input area TA.
When the “text” key K5 is input, a character input area TA shown in FIG. 4 is displayed. In this character input area TA, a character string input field TA1, a font setting field TA2, a font size setting field TA3, a font color setting field TA4, an “OK” key TA5 and a “Cancel” key TA6 are provided. Then, after inputting characters (for example, “presentation”) in the character string input field TA1, when the “OK” key TA5 is input, as shown in FIG. 3, the input character string (for example, “presentation”) Are arranged in the layout area RA with the set font, size and color. When the “Cancel” key TA6 is input, the input character string is not arranged in the layout area RA and the character input area TA is hidden.

Returning to FIG. 3, when the “graphic drawing” key K6 is input, a graphic selection area is displayed. In this figure selection area, for example, figures such as squares, triangles and circles, and figures such as straight lines, curves and arrows are displayed as selection items. When a predetermined graphic is selected, the graphic is arranged in the layout area RA. The position and size of the figure can be adjusted by an input operation on the operation means 31 in the layout area RA.
Note that the image image, character string, and figure inserted in the layout area RA can be deleted from the layout area RA.

When the “transmission start” key K7 in the second operation area A2 is input, the packet including the background image, image image, character string, and graphic image data set in the layout area RA is selected from the list L. Sent to the device. At this time, if a moving image and an application are selected, the control unit 37 continues to transmit a packet including the moving image and the image data of the application to the selected external device.
When the “transmission end” key K8 is entered, packet transmission is terminated.

FIG. 5 is a block diagram illustrating a configuration of the image transmission application execution unit 4.
In order to execute the image transmission application as described above, the image transmission application execution unit 4 includes a main control unit 41, a transmission destination setting unit 42, a display size acquisition unit 43, and a layout area formation unit 44 as shown in FIG. , Operation determination unit 45, image selection unit 46, figure drawing unit 47, image arrangement unit 48, order setting unit 49, layout setting unit 50, background data generation unit 51, area information acquisition unit 52, video development unit 53, data generation Unit 54 and data transmission unit 55.

The main control unit 41 controls the entire operation of the image transmission application execution unit 4, and causes the operation image generation unit 34 to generate and display the above-described runtime screen as the image transmission application is executed. Further, the main control unit 41 controls the execution state of the image transmission application by causing the function units 42 to 55 to function as necessary.
The transmission destination setting unit 42 sets the external device selected from the list L as the transmission destination device of the image data.

The display size acquisition unit 43 acquires the image display size of the transmission destination device.
The layout area forming unit 44 displays the layout area RA in the runtime screen based on the acquired image display size.
The operation determination unit 45 determines a user operation on the operation unit 31 when executing the image transmission application.

The image selection unit 46 corresponds to the selection unit of the present invention together with the graphic drawing unit 47 to be described later, and executes processing according to the function executed when the keys K1 to K4 are input to display the display image by the external device. Select the object that you want to configure. Such an image selection unit 46 includes a background selection unit 461, a still image selection unit 462, a moving image selection unit 463, and an application selection unit 464.
The background selection unit 461 displays the above-described dialog when the “background” key K1 is input, and sets the path of the selected still image file and the like in the transmission target list stored in the storage unit 32.

The still image selection unit 462 displays the above-described dialog when the “still image” key K2 is input, and transmits the path of the selected still image file, the position and size of the image image in the layout area RA, and the like. Set in the target list.
The moving image selection unit 463 displays the above-described dialog when the “moving image” key K3 is input, and transmits the path of the selected moving image file, the position and size of the image image in the layout area RA, and the like. Set to list. Note that the reproduction of the moving image file is started by the moving image developing unit 53 described later when the “transmission start” key K7 is input.
The application selection unit 464 displays the aforementioned list when the “application” key K4 is input, and sets the name of the selected application, the position and size of the image image in the layout area RA, and the like as the transmission target list. To do.

The graphic drawing unit 47 includes a text generation unit 471 and a graphic generation unit 472.
When the “text” key K5 is input, the text generation unit 471 displays the character input area TA described above, and develops the image data of the input character string in the drawing memory 35.
The graphic generation unit 472 displays the graphic selection area described above when the “graphic drawing” key K6 is input, and develops image data related to the selected graphic in the drawing memory 35.
In addition, the text generation unit 471 and the graphic generation unit 472 store the input character string, the type of the selected graphic, and the position and size of the character string and the graphic in the layout area RA in the transmission target list. Set.

The image arrangement unit 48 arranges image images of the selected and input objects (background, still image, moving image and application, character string, and graphic) on the layout area RA.
The rank setting unit 49 ranks (numbers) the objects arranged in the layout area RA in the order of setting the objects. Specifically, the rank setting unit 49 sets the rank of the object in the transmission target list every time the object is arranged.

The layout setting unit 50 includes a position setting unit 501, a size setting unit 502, and a hierarchy setting unit 503.
The position setting unit 501 and the size setting unit 502 change the position and size of the image image of each object in the layout area RA according to an input operation to the operation unit 31. Further, the position setting unit 501 and the size setting unit 502 update the contents of the position and size of the object set in the transmission target list based on the changed position and size.

  The hierarchy setting unit 503 sets a hierarchy indicating the overlap of objects. Specifically, when the plurality of image images are arranged so as to overlap in the layout area RA, the hierarchy setting unit 503 sets the corresponding object hierarchy to “1”, “2” in order from the image on the backmost side. ”,...,“ M ”. Note that the hierarchy of objects corresponding to image images arranged so that other image images do not overlap is “1”. Further, the hierarchy of each object corresponding to a plurality of image images arranged so as to overlap each other and not overlap each other is a value obtained by adding 1 to the hierarchy of the one object. Such a hierarchy setting unit 503 updates the hierarchy of each object in the image transmission list every time each image image in the layout area RA is operated.

The following functional units 51 to 55 operate when the “start transmission” key K7 is input.
The background data generation unit 51 resizes the image data of the still image file set as the background in the image transmission list in accordance with the image display size of the transmission destination device, and from the resized image data, A packet is generated according to the communication form. This packet is transmitted to the transmission destination device by the data transmission unit 55. When the background is not set, the background data generation unit 51 generates a packet related to the image data of the black image.

The area information acquisition unit 52 acquires the position, size, rank, hierarchy, and type (any type of still image, moving image, application, text, and graphic) of each object set in the image transmission list.
The moving image expanding unit 53 expands the moving image file set in the image transmission list in the drawing memory 35.

  The data generation unit 54 generates a packet including image data (image data relating to each object) other than the background of the display image at the transmission destination device. Specifically, the data generation unit 54 generates a packet including image data of the object in the hierarchical order of the object. Such a data generation unit 54 includes a target layer selection unit 541, a target region selection unit 542, a region type determination unit 543, an image capture unit 544, a layer determination unit 545, a change determination unit 546, a transmission data generation unit 547, a target region. A determination unit 548 and a target hierarchy determination unit 549 are provided.

The target hierarchy selection unit 541 selects the hierarchy where the target object (target object) is located as the target hierarchy.
The target area selection unit 542 selects a target object from objects located in the target hierarchy. Note that, when there are a plurality of objects in the same hierarchy, the target area selection unit 542 selects the target objects in order from the lowest rank object among the ranks set by the rank setting unit 49.

The area type determination unit 543 determines the type of the target object. Specifically, the region type determination unit 543 is based on the information of each object acquired by the region information acquisition unit 52, and the target object is a still object (still image, text, and graphic) whose image data does not change over time. Or whether the image data is a moving object (moving image and application) that changes over time.
The image capture unit 544 captures the image data of the target object developed in the drawing memory 35 and copies the image data to the frame memory 36. At this time, when the target object is a moving object, the image capture unit 544 copies image data for one frame to the frame memory 36.

The hierarchy determination unit 545 determines whether or not the target hierarchy is the first layer.
When the target object is a moving object, the change determination unit 546 determines whether there is a change between the image data copied to the frame memory 36 and the image data already copied.

The transmission data generation unit 547 generates a packet to be transmitted to the transmission destination device based on the image data of the target object copied to the frame memory 36 and the information on each object acquired by the area information acquisition unit 52. The transmission data generation unit 547 includes an image processing unit 5471, a display position calculation unit 5472, a packet generation unit 5473, and a difference acquisition unit 5474.
The image processing unit 5471 matches the image display size of the transmission destination device with respect to the size of the layout area RA and the size of the image data with respect to the size of the target object in the layout area RA. Then, the image data is resized.

Based on the position of the target object in the layout area RA (the position of the target object set in the image transmission list), the display position calculation unit 5472 displays the image data of the target object in the display image on the transmission destination device. Calculate the position.
The packet generation unit 5473 corresponds to the transmission data generation unit of the present invention, and is resized with header information including the size changed by the image processing unit 5471 and the display position calculated by the display position calculation unit 5472. A packet having image data is generated.

When the difference acquisition unit 5474 determines that there is a change between the newly copied image data and the already copied image data among the image data of the same target object by the change determination unit 546. In addition, a minimum rectangular area that is a difference from the image data that has already been copied is acquired as the difference image data from the newly copied image data.
When difference image data is acquired by the difference acquisition unit 5474, the image processing unit 5471 resizes the difference image data, and the display position calculation unit 5472 displays the difference image data. Calculate the position.

  The target area determination unit 548 determines whether all objects in the target hierarchy have been set as target objects. When the target area determination unit 548 determines that there is an object that is not set as the target object, the target area selection unit 542 selects the next ranked object as the target object.

The target hierarchy determination unit 549 determines whether all hierarchies have been selected as the target hierarchy. Here, when the target hierarchy determination unit 549 determines that there is a hierarchy that is not selected as the target hierarchy, the target hierarchy selection unit 541 adds 1 to the value “n” indicating the current hierarchy. Is selected as the target hierarchy. When the target hierarchy determination unit 549 determines that all hierarchies have been selected as the target hierarchy, the target hierarchy selection unit 541 sets “1” to “n” and targets the first layer. Select as a hierarchy.
The data transmission unit 55 transmits the packets generated by the background data generation unit 51 and the data generation unit 54 to the transmission destination device.

[Image transmission application runtime processing]
FIG. 6 is a flowchart showing the image transmission application execution process.
When the user performs an operation for executing the image transmission application, the image transmission application execution unit 4 executes the image transmission application execution time process described below.
In this image transmission application execution process, as shown in FIG. 6, first, the main control unit 41 causes the operation image generation means 34 and the image display means 33 to execute an image transmission application execution screen (see FIGS. 2 and 3). ) Is displayed (step SA01).
Thereafter, the transmission destination setting unit 42 sets the external device selected by the user as the transmission destination device (step SA02), and the display size acquisition unit 43 acquires the image display size from the set transmission destination device. (Step SA03). Then, the layout area forming unit 44 causes the operation image generating unit 34 to display the layout area RA in which the image display size is reduced at a predetermined rate in the work area A3 of the runtime screen (step SA04).
Thereafter, the image transmission application execution unit 4 performs a transmission target setting process SB.

FIG. 7 is a flowchart showing the transmission target setting process SB.
The transmission target setting process SB is a process for setting the above-described object.
In this transmission target setting process SB, as shown in FIG. 7, first, the operation determination unit 45 determines whether or not the “background” key K1 has been input and the still image file set as the background has been selected. (Step SB01). If it is determined that the image is selected, the background selection unit 461 sets the path of the selected still image file in the image transmission list. At this time, the image placement unit 48 develops the selected still image file in the drawing memory 35 and sets the image of the still image file as the background of the layout area RA (step SB02). Thereafter, the image transmission application execution unit 4 ends the transmission target setting process SB.

  If the operation determination unit 45 determines that the background is not selected, the operation determination unit 45 determines whether the “still image” key K2 is input and a still image file is selected (step SB03). If it is determined that the still image has been selected, the still image selection unit 462 sets the path of the selected still image file and the like in the image transmission list. At this time, the image placement unit 48 places the thumbnails of the still image file in a predetermined size on the layout area RA (step SB04). Then, the image transmission application execution part 4 transfers a process to step SB11.

  If the operation determination unit 45 determines that a still image has not been selected, the operation determination unit 45 determines whether the “moving image” key K3 has been input and a moving image file has been selected (step SB05). Then, when it is determined that it has been selected, the moving image selection unit 463 sets the path of the selected moving image file or the like in the image transmission list. At this time, the image arrangement unit 48 arranges the thumbnails of the moving image file in a predetermined size on the layout area RA (step SB06). Then, the image transmission application execution part 4 transfers a process to step SB11.

  If the operation determination unit 45 determines that the moving image is not selected, the operation determination unit 45 determines whether the “application” key K4 is input and the application is selected (step SB07). If it is determined that the application has been selected, the application selection unit 464 sets information (name or the like) of the selected application in the image transmission list. At this time, the image placement unit 48 places the image of the selected application on the screen at the predetermined size on the layout area RA (step SB08). Then, the image transmission application execution part 4 transfers a process to step SB11.

If the operation determination unit 45 determines that the application is not selected, it determines whether the “text” key K5 or the “graphic drawing” key K6 has been input, and text input or graphic selection has been performed. (Step SB09). When it is determined that text input or graphic selection has been performed, the text generation unit 471 and the graphic generation unit 472 set the input text and the selected graphic information in the image transmission list, and image layout The unit 48 arranges the text image and graphic image on the layout area RA (step SB10). Then, the image transmission application execution part 4 transfers a process to step SB11.
If the operation determination unit 45 determines that text input or graphic selection has not been performed, the image transmission application execution unit 4 ends the transmission target setting process SB.

In step SB11, the order setting unit 49 sets the order of the objects in the order in which the objects are set in the image transmission list (the order in which still images, moving images, applications, text, and graphics are arranged in the layout area RA). (Step SB11).
When the position and size of the image image in the layout area RA are changed according to the user's operation, the position setting unit 501 and the size setting unit 502 cause the position and size of the corresponding object in the image transmission list. Is updated (step SB12). At this time, when a change occurs in the object hierarchy, the hierarchy setting unit 503 updates the hierarchy in the image transmission list of each object (step SB13).
Thus, the transmission target setting process SB ends.

Returning to FIG. 6, after the transmission target setting process SB, the operation determination unit 45 determines whether or not the “transmission start” key K7 is input (step SA05). Here, when the operation determination unit 45 determines that the key K7 is not input, the image transmission application execution unit 4 repeatedly executes the transmission target setting process SB.
On the other hand, when it is determined that the key K7 has been input, the image transmission application execution unit 4 executes the setting information acquisition process SC.

FIG. 8 is a flowchart showing the setting information acquisition process SC.
The setting information acquisition process SC is a process for transmitting image data set as a background and acquiring information related to each object set in the layout area RA.
In this setting information acquisition process SC, as shown in FIG. 8, first, the background data generation unit 51 determines whether or not a background is set in the image transmission list (step SC01).
When the background data generation unit 51 determines that the background is set, the background data generation unit 51 generates a packet based on the still image file set as the background in the image transmission list, and the data transmission unit 55 Transmit to the destination device (step SC02).
On the other hand, if the background data generation unit 51 determines that the background is not set, the background data generation unit 51 generates a packet related to the black image data, and the data transmission unit 55 transmits the transmission packet (step SC03).
The destination device that has received the packet related to the background displays an image based on the packet as the background of the display image.

After these steps SC02 and SC03, the area information acquisition unit 52 acquires the position and size of each object set in the image transmission list (step SC04). The area information acquisition unit 52 acquires the order and hierarchy of each object from the image transmission list (step SC05), and acquires the type of each object (step SC06).
Thereafter, the moving image developing unit 53 determines whether or not a moving image file is set in the image transmission list (step SC07). If it is determined that the moving image file is set, the moving image developing unit 53 stores the moving image file in the drawing memory 35. (Step SC08).
Thus, the setting information acquisition process SC ends.

9 and 10 are flowcharts showing the data transmission process SD.
Returning to FIG. 6, the image transmission application execution unit 4 executes the data transmission process SD after the setting information acquisition process SC. The data transmission process SD is a process of sequentially selecting target objects and sequentially transmitting packets based on the image data of the target objects.
In this data transmission process SD, as shown in FIG. 9, first, the target hierarchy selection unit 541 of the data generation unit 54 sets “1” to the value “n” indicating the target hierarchy (step SD01), and the target hierarchy The nth layer (the first layer at this stage) is selected (step SD02).
Then, the target area selection unit 542 selects the lowest-order object among the objects located in the nth layer as the target object (step SD03).

Next, the image capture unit 544 captures image data corresponding to the target object on the drawing memory 35 and copies the image data to the frame memory 36 (step SD04). At this time, if the target object is a moving object, image data for one frame is copied.
Thereafter, the image transmission application execution unit 4 executes a packet transmission process SE.

FIG. 11 is a flowchart showing the packet transmission process SE.
The packet transmission process SE is a process for generating a packet based on the image data copied to the frame memory 36 and transmitting the packet to the transmission destination device.
In this packet transmission process SE, as shown in FIG. 11, first, the image processing unit 5471 of the transmission data generation unit 547 resizes the image data related to the copied target object in accordance with the image display size of the transmission destination device. (Step SE01).

Further, the display position calculation unit 5472 calculates the combined position of the target object image in the display image of the destination device based on the position of the target object image in the layout area RA (step SE02).
Then, the packet generation unit 5473 generates a packet including the header information including the position of the resized image data and the resized image data, and transmits the packet to the transmission destination device by the data transmission unit 55 ( Step SE03).
Thus, the packet transmission process SE ends.

Returning to FIG. 9, after the packet transmission process SE, the target area determination unit 548 determines whether all objects in the target hierarchy have been selected as target objects (step SD05).
Here, when it is determined that there is an unselected object, the target area selection unit 542 targets the object in the lowest order among the objects that are located in the target hierarchy and are not selected as the target object. Select as an object (step SD06).
Thereafter, the image transmission application execution unit 4 returns to Step SD04.

On the other hand, when it is determined that all objects in the target hierarchy are selected as the target objects, the target hierarchy determination unit 549 determines whether all the hierarchies are selected as the target hierarchy (step SD07). If it is determined that there is an unselected hierarchy, the target hierarchy selection unit 541 adds 1 to the value “n” indicating the target hierarchy (step SD08), and the process returns to step SD02. Thereby, the hierarchy indicated by the value “n” is selected as the target hierarchy.
On the other hand, when it is determined that all hierarchies have been selected as the target hierarchies, the image transmission application executing unit 4 shifts the processing to step SD09.

FIG. 12 is a diagram illustrating a display image displayed on the transmission destination device based on the image data transmitted from the PC 3.
By the processing so far, the image data (packet) of the display image for the first frame at the transmission destination device is transmitted. In the transmission destination device that has received such image data, as shown in FIG. 12, a display image including the image of each object is displayed in the layout of each object set in the layout area RA.

In step SD09, as shown in FIG. 10, the target hierarchy selecting unit 541 sets the value “n” indicating the target hierarchy to “1” (step SD09), and the hierarchy indicated by the “n” (at this time, the first level) 1st layer) is selected as the target hierarchy (step SD10).
Thereafter, the target area selection unit 542 selects an object with the lowest order among the objects located in the nth layer as the target hierarchy (step SD11).

Next, the hierarchy determination unit 545 determines whether or not the current target hierarchy is the first layer (step SD12). In this determination process, when it is determined that the target hierarchy is the first layer, the area type determination unit 543 determines whether the target object is a static object (still image, text, and graphic) or a moving object (moving image) And application) (step SD13). At this time, if it is determined that the target object is a static object, the image transmission application execution unit 4 proceeds to step SD18.
Here, it is not necessary to update the image data of the static object located in the first layer which is the backmost layer. The image data has already been transmitted when the first frame of image data is transmitted. For this reason, when transmitting image data for the second and subsequent frames, the image data of the first layer still object is not transmitted, so that the same data is prevented from being transmitted again and the amount of transmitted data is reduced.

On the other hand, when it is determined that the target object is a moving object, the image capture unit 544 copies the image data for one frame of the target object from the drawing memory 35 to the frame memory 36 (step SD14).
Thereafter, the change determination unit 546 compares the newly copied image data with the already copied image data, and determines whether or not a change has occurred between them (step SD15). Here, if it is determined that there is no change, it is determined that there is no need to update the image data related to the target object even if the target object is arranged so that another object overlaps the target object. The image transmission application execution unit 4 proceeds to step SD18.

On the other hand, if the change determination unit 546 determines that there is a change, the difference acquisition unit 5474 calculates difference image data that is a difference from the image data that has already been copied from the newly copied image data. Obtain (step SD16).
Then, the image transmission application execution unit 4 performs packet generation and transmission based on the difference image data by the packet transmission process SE described above, and proceeds to step SD18.

On the other hand, if it is determined in step SD12 that the target hierarchy is not the first layer, the image capture unit 544 copies the image data of the target object from the drawing memory 35 to the frame memory 36 (step SD17). . Then, the image transmission application execution unit 4 generates and transmits a packet based on the copied image data by the packet transmission process SE described above, and proceeds to step SD18.
For this reason, for target objects that are not located on the first layer, that is, target objects for which other objects are located on the back side, image data is transmitted to the destination device for each frame. As a result, even when there is a change in another object located on the back side of the target object, and an image of the other object is updated, an appropriate image can be displayed in the display area of the target object image. it can.

  In step SD18, as in step SD05 described above, the target area determination unit 548 determines whether all objects in the target hierarchy have been selected as target objects (step SD18). If it is determined that there is an unselected object, the target area selection unit 542 selects the lowest-order object that is not selected as the target object in the target hierarchy (step SD19), and the image transmission application The execution unit 4 moves the process to step SD11.

On the other hand, when the target area determination unit 548 determines that all objects in the target hierarchy have been selected as target objects, the target hierarchy determination unit 549 determines whether all the hierarchies have been selected as target hierarchies (steps). SD20). When the target hierarchy determination unit 549 determines that there is an unselected hierarchy, the target hierarchy selection unit 541 adds 1 to the value “n” indicating the target hierarchy (step SD21), and the process proceeds to step SD10. Return.
If the target hierarchy determination unit 549 determines that all hierarchies have been selected as the target hierarchy, the image transmission application execution unit 4 proceeds to step SD09 to transmit image data related to the next frame. Prepare.
Thereby, each object is sequentially selected, and image data related to the object is sequentially transmitted to the transmission destination device, whereby the image is updated for each frame in the transmission destination device.

  If the image transmission application is being executed, the setting information acquisition process SC and the data transmission process SD are executed even when the window of the image transmission application is not active. For this reason, even if it is arranged so that the window of the other application overlaps the window of the image transmission application, or even if a predetermined process is executed in another application (for example, Notepad) A packet having image data of each object set in the layout area RA and header information corresponding to the layout of each object is transmitted to the transmission destination device.

Returning to FIG. 6, the operation determination unit 45 determines whether or not the “transmission end” key K8 is input during the data transmission process SD (step SA06). If the operation determination unit 45 determines that the key K8 has not been input, the image transmission application execution unit 4 continues to execute the data transmission process SD.
On the other hand, when the operation determination unit 45 determines that the key K8 has been input, the main control unit 41 ends the data transmission process SD (step SA07).
Thereafter, the operation determination unit 45 determines whether or not an editing operation has been performed on the runtime screen of the image transmission application (step SA08). If it is determined that the editing operation has been performed, the image transmission application execution unit 4 executes the transmission target setting process SB again, the editing operation is not performed, and the image transmission application is terminated. When it is determined that the image transmission application has been broken, the image transmission application execution unit 4 ends the image transmission application.

The display system according to the present embodiment described above has the following effects.
(1) Packets including image data of an object (background, still image, moving image, and application) selected by the image selection unit 46 and an object (character string and graphic) input and selected by the graphic drawing unit 47 Data for transmission) is generated, and the packet is transmitted to the destination device (projector 2). According to this, it is possible to prevent an image other than the object selected by the user of the PC 3 from being included in the display image displayed on the transmission destination device. Therefore, the user of the PC 3 can freely set the display image of the transmission destination device, and can prevent the transmission destination device from displaying an image that the user does not want to see.

  (2) The layout setting unit 50 can set the layout (for example, display position and size) of the object in the display image at the transmission destination device. The image of the object can be displayed. Further, when a plurality of objects are selected, the images of these objects can be displayed so that at least some of the images of the respective objects overlap each other. Accordingly, it is possible to improve the degree of freedom of setting the display image in the transmission destination device.

  (3) The layout area forming unit 44 forms and displays a layout area RA corresponding to the image display size of the transmission destination device acquired by the display size acquisition unit 43 on the screen during execution of the image transmission application. Then, the image arrangement unit 48 arranges the image image corresponding to the selected and input object in the layout area RA, and the layout setting unit 50 determines the transmission destination device according to the layout of the image image in the layout area RA. The layout of the object image in the display image at is set. According to this, the setting state of the display image can be visually determined, and the display image can be easily set.

  (4) At the time of generating a packet that is transmission data, the data generation unit 54 generates a packet in order from the object of the lowest hierarchy, that is, the object on the back side. According to this, in the display image, the image of the object on the back side is updated first, and the image of the object on the front side is updated later. be able to. Accordingly, the display image can be displayed according to the set layout.

  (5) The data generation unit 54 generates a packet for each object. According to this, when a static object is arranged so that other objects do not overlap, a moving object that needs to update an image is arranged without transmitting image data of the static object again. In this case, the image data of the moving object can be sequentially transmitted to the transmission destination device. Therefore, the amount of data transmitted to the transmission destination device can be reduced.

[2. Second Embodiment]
Next, a display system according to a second embodiment of the present invention will be described.
The display system according to the present embodiment has the same configuration as that of the display system 1 described above. However, in the display system 1, every time the target object is selected, the image data of the object is transmitted to the transmission destination device. On the other hand, in the display system according to the present embodiment, a packet for one screen including the image data of each object is generated and transmitted. In this respect, the display system according to the present embodiment and the display system 1 are different. In the following description, parts that are the same as or substantially the same as those already described are assigned the same reference numerals and description thereof is omitted.

The display system according to the present embodiment includes a projector 2 as an image display device and a PC 3A as an image transmission device that transmits image data to the projector 2. The projector 2 and the PC 3A are the same as the display system 1. Are connected by a LAN.
The PC 3A has the same configuration as the PC 3 except that the control means 37A is provided instead of the control means 37. The control unit 37A has the same configuration as the control unit 37 except that the image transmission application execution unit 4A is provided instead of the image transmission application execution unit 4.

FIG. 13 is a block diagram illustrating a configuration of an image transmission application execution unit 4A included in the PC 3A of the display system according to the present embodiment.
The image transmission application execution unit 4A reads the image transmission program stored in the storage unit 32 according to the user's operation, and executes the image transmission application. As shown in FIG. 13, the image transmission application execution unit 4A includes a main control unit 41, a transmission destination setting unit 42, a display size acquisition unit 43, a layout area formation unit 44, an operation determination unit 45, an image selection unit 46, and a graphic. A drawing unit 47, an image arrangement unit 48, a rank setting unit 49, a layout setting unit 50, an area information acquisition unit 52, a moving image development unit 53, a data generation unit 54A, and a data transmission unit 55 are provided.

  The data generation unit 54A generates a packet for one display image having image data of each object set in the layout area RA. As shown in FIG. 13, the data generation unit 54A includes a background setting determination unit 550, a black image generation unit 551, an image capture unit 544, a target hierarchy selection unit 541, a target region selection unit 542, a completed image generation unit 552, a target An area determination unit 548, a target hierarchy determination unit 549, a change determination unit 553, a difference acquisition unit 554, and a packet generation unit 555 are provided.

Among these, the background setting determination unit 550 determines whether or not a still image file as a background is selected in the image transmission list.
The black image generation unit 551 generates black image data in the drawing memory 35 when the background setting determination unit 550 determines that a still image file as a background is not selected.

The completed image generation unit 552 generates image data of a display image (one frame including a background and an image of each object) for one screen displayed on the transmission destination device. The completed image generation unit 552 includes an image processing unit 5471, a display position calculation unit 5472, and an image generation unit 5521.
Among these, the image generation unit 5521 combines the image data resized by the image processing unit 5471 with the position calculated by the display position calculation unit 5472, thereby converting the image data of the display image for one screen into the frame memory 36. Generate on top.

The change determination unit 553 uses the image data for one screen newly generated in the frame memory 36 by the completed image generation unit 552 and the image data for one screen that has already been generated (image data before one frame). In comparison, it is determined whether there is a change between them.
When the change determination unit 553 determines that there is a change, the difference acquisition unit 554 acquires difference image data that is a difference from the already generated image data from the newly generated image data. Since there is no comparison target image data for the first frame of image data, the entire newly generated image data is acquired as difference image data.

FIG. 14 is a diagram illustrating an example of image data included in a packet generated by the packet generation unit 555.
The packet generation unit 555 corresponds to the transmission data generation unit of the present invention, and includes header information indicating the difference image data acquired by the difference acquisition unit 554 and the display position (combination position) of the image corresponding to the difference image data. Generates a packet having This packet is transmitted to the transmission destination device by the data transmission unit 55.
Here, for example, as shown in the upper part of FIG. 14, the image corresponding to the difference image data may not be rectangular. In such a case, as shown in the lower part of FIG. 14, the packet generation unit 555 divides the image corresponding to the difference image data into a plurality of rectangular areas, and generates a packet based on the rectangular image data corresponding to each rectangular area. Generate.

[Image transmission application runtime processing]
FIG. 15 is a flowchart illustrating the image transmission application execution process executed by the PC 3A.
When the user performs an operation for executing the image transmission application on the operation unit 31, the image transmission application execution unit 4A performs the above-described steps SA01 to SA04 and the transmission target setting process as shown in FIG. SB is performed. Thereafter, in step SA05, it is determined whether or not the “transmission start” key K7 has been input. If it is determined that the key K7 has not been input, the image transmission application execution unit 4A performs the transmission target setting process. When SB is executed again and it is determined that the key K7 has been input, the image transmission application execution unit 4A performs the setting information acquisition process SF.

FIG. 16 is a flowchart showing the setting information acquisition process SF.
In the setting information acquisition process SF, the process related to the background in the setting information acquisition process SC is omitted, and the same processes as in steps SC04 to SC08 are executed. That is, in the setting information acquisition process SF, as shown in FIG. 16, the area information acquisition unit 52 acquires the position, size, rank, hierarchy, and type of each object set in the image transmission list (steps SC04 to SC06). ). Then, the moving image developing unit 53 determines whether or not a moving image file is set in the image transmission list (step SC07). If it is determined that the moving image file is set, the moving image file is expanded in the drawing memory 35. (Step SC08).
Thus, the setting information acquisition process SF ends.

FIG. 17 is a flowchart showing the data transmission process SG.
Returning to FIG. 15, after the setting information acquisition process SF, the image transmission application execution unit 4A executes the data transmission process SG.
In this data transmission process SG, as shown in FIG. 17, first, the background setting determination unit 550 determines whether or not a still image file is selected as a background in the image transmission list (step SG01). If it is determined that the image is selected, the image capture unit 544 captures the image data of the corresponding image file from the drawing memory 35 and copies it to the frame memory 36 (step SG02).

On the other hand, if it is determined that it is not selected, the black image generation unit 551 generates black image data in the drawing memory 35, and the image capture unit 544 copies the black image data to the frame memory 36 ( Step SG03).
After these steps SG02 and SG03, the image transmission application execution unit 4A sets the copied background image data as the target data, and executes the image generation process SH for the target data.

FIG. 18 is a flowchart showing the image generation process SH.
The image generation process SH is a process for generating image data for one display image.
In this image generation process SH, as shown in FIG. 18, first, the image processing unit 5471 of the completed image generation unit 552 resizes the image data that is the target data (step SH01).
Then, the display position calculation unit 5472 calculates the position of the resized image data in the display image from the position of the target data in the layout area RA (step SH02).

Next, the image generation unit 5521 draws the resized image data at the position calculated by the display position calculation unit 5472 in the image data of the display image drawn in the frame memory 36, and displays the display image being generated. The image data is combined (step SH03).
By performing such image generation processing SH on the background and image data of each object, image data for one screen of the display image (image data for one frame) is generated on the frame memory 36.
Thus, the image generation process SH is completed.

  Returning to FIG. 17, after the image generation process SH for the background image data, the image transmission application execution unit 4A performs the same process as steps SD01 to SD08 in the data transmission process SD described above. Note that after SD04, the image generation process SH described above is performed on the image data of the target object instead of the packet transmission process SE.

Here, in the determination process of step SD07, when the target hierarchy determination unit 549 determines that all hierarchies have been selected as the target hierarchy, the change determination unit 553 displays an image for one newly generated display image. The data is compared with the already generated image data for one screen of the previous frame, and it is determined whether or not a change has occurred between them (step SG04).
If it is determined that no change has occurred, the image transmission application execution unit 4A determines that it is not necessary to transmit the image data of the newly generated display image, and returns the process to SG01.

On the other hand, if it is determined that a change has occurred, the difference acquisition unit 554 acquires difference image data for the image data of the display image one frame before from the newly generated image data of the display image (step SG05). ).
Thereafter, as described above, the packet generation unit 555 divides the difference image data as necessary, generates a packet including the rectangular image data and header information indicating the position of the rectangular image data, and The packet is transmitted to the destination device by the data transmission unit 55 (step SG06). Thereafter, the image transmission application execution unit 4A returns the process to step SG01. Thereby, when a change occurs, image data for one frame of newly generated display image is transmitted to the transmission destination device.

Returning to FIG. 15, the operation determination unit 45 determines whether or not the “transmission end” key K8 is input during the data transmission process SG (step SA06). At this time, if it is determined that the key K8 has not been input, the image transmission application execution unit 4A continues the data transmission process SG.
On the other hand, if it is determined that the key K8 has been input, the main control unit 41 ends the data transmission process SD and ends the transmission of the packet to the destination device (step SA07).

Then, the operation determination unit 45 determines whether or not an editing operation has been performed on the image transmission application runtime screen (step SA08), and when it is determined that the editing operation has been performed, the image transmission application execution unit. 4 again executes the above-described transmission target setting process SB.
If the operation determining unit 45 determines that the editing operation has not been performed and the image transmission application termination operation has been performed, the image transmission application executing unit 4 terminates the image transmission application.

According to the display system according to the present embodiment described above, the same effects as the effects (1) to (3) that can be achieved by the display system 1 described above can be achieved, and the following effects can be obtained.
(6) The data generation unit 54A generates image data for one screen of the display image by combining the image data of the objects in order from the object of the lowest hierarchy, and transmits a packet that is transmission data corresponding to the image data. Generate. According to this, it is possible to prevent a display image in which the order of the images of each object has been lost from being temporarily displayed. Therefore, the display image according to the set layout can be displayed reliably and appropriately.

  (7) The packet transmitted to the transmission destination device includes a difference between the newly generated image data for one screen of the display image and the image data generated before the image data. That is, when there is a change in each image data, the image data of the packet is the difference image data, and the display position of the image corresponding to the difference image data is indicated by the header information. According to this, since it is not necessary to sequentially transmit image data for one screen having a large data amount, the data amount to be transmitted to the transmission destination device can be reduced.

  (8) If the image corresponding to the difference image data acquired by the difference acquisition unit 554 is not rectangular, the packet generation unit 555 divides the image into a plurality of rectangular images, and the rectangles of the divided rectangular images respectively. A packet including image data is generated. According to this, when forming a display image at the transmission destination device, it is possible to easily combine the updated image data with the image data of the currently displayed display image. Therefore, the burden of image display processing in the transmission destination device can be reduced, and the display image can be appropriately displayed.

[3. Third Embodiment]
Next, a third embodiment according to the present invention will be described.
The display system according to the present embodiment has the same configuration as the display system shown in the second embodiment. However, in the display system according to the second embodiment, when image data of a non-rectangular image is acquired as difference image data, the packet generation unit 555 divides the difference image data into a plurality of rectangular areas, and A packet including rectangular image data corresponding to the rectangular area was generated. In contrast, the display system according to the present embodiment adds a transparent area to a non-rectangular image corresponding to difference image data to form one rectangular area, and generates a packet including the image data of the rectangular area. However, it is different from the display system according to the second embodiment.

FIG. 19 is a schematic diagram illustrating image data generated by the packet generation unit of the PC configuring the display system according to the present embodiment.
The display system of this embodiment includes the projector 2 and the PC 3A described above.
Among these, when the differential image data of the non-rectangular image as shown in the upper part of FIG. 19 is acquired, the packet generation unit 555 of the PC 3A according to the present embodiment, as shown in the lower part of FIG. A minimum rectangular area is formed by combining the area DA of the difference image data and the transparent area PA, and rectangular image data corresponding to the rectangular area is generated. Then, the packet generation unit 555 generates a packet including the generated rectangular image data and header information indicating the display position of the rectangular area in the display image at the transmission destination device, and the data transmission unit 55 Send.

On the other hand, in the projector 2 as the transmission destination device, when the transparent area PA receives a packet included in the image data, the packet analysis unit 223 restores the image data from the packet, and the image development unit 224 restores the restored image. The data and the image data of the display image formed in the image memory 225 are combined. At this time, the image development unit 224 does not combine the transmissive areas PA, but combines only the image data corresponding to the areas DA.
As a result, even when the differential image data of the non-rectangular image is acquired by the PC 3A, the projector 2 appropriately combines the differential image data with the display image that has already been formed. Will be updated appropriately.

  According to the display system according to the present embodiment described above, the effects (1) to (3) that the display system 1 can exhibit and the effects (6) that the display system shown in the second embodiment can exhibit. ) And (7), the following effects can be obtained.

  (9) If the image corresponding to the difference image data acquired by the difference acquisition unit 554 is not rectangular, the packet generation unit 555 adds a transparent area PA that is not displayed on the transmission destination device to form a rectangular image. Generate a packet including rectangular image data. According to this, when forming a display image at the transmission destination device (projector 2), it is possible to easily combine the updated image data with the image data of the display image currently being displayed. Therefore, the burden of image display processing in the transmission destination device can be reduced, and the display image can be appropriately displayed. Further, it is sufficient to generate one packet for one change area, and the amount of data transmitted to the transmission destination device can be reduced.

[4. Modification of Embodiment]
The present invention is not limited to the above-described embodiment, and modifications, improvements, and the like within the scope that can achieve the object of the present invention are included in the present invention.
In each of the above embodiments, as an object included in a display image, a still image file selected as a background image, a still image file selected as a still image, a moving image file selected as a moving image, an application being executed, an input However, the present invention is not limited to this, and other image data may be included. In addition, a plurality of these objects may not be selected, and the number of selected objects may be set as appropriate.

  In each of the above embodiments, the PCs 3 and 3A as the image transmission device and the projector as the display device are connected by a LAN. However, the present invention is not limited to this, and other formats such as USB and DVI (Digital Visual Interface) are used. You may connect. In such a case, the data generation units 54 and 54A may generate transmission data corresponding to the connection format.

  In each of the above embodiments, the data generation units 54 and 54A generate a packet including image data resized according to the image display size of the transmission destination device as transmission data, but the present invention is not limited to this. For example, the display device as the transmission destination device resizes the received image data according to the image display size of the display device, calculates the display position of the image according to the resized image data in the display image, The display image may be displayed.

  In each of the embodiments described above, the image transmission program related to the image transmission application is stored in the storage unit 32 configured by the HDD. However, the present invention is not limited to this. That is, the image transmission program may be recorded on a disc-type recording medium such as a CD (Compact Disc) and a DVD (Digital Versatile Disc), or may be recorded on a semiconductor memory. Then, it is only necessary to read the image transmission application recorded on these recording media and execute the image transmission application in accordance with a user operation.

  In each of the above embodiments, the projector 2 is exemplified by a projector including a liquid crystal panel as a light modulation device. However, any other light modulation device may be used as long as it modulates an incident light beam according to image information to form an optical image. You may employ | adopt the light modulation apparatus of a structure. For example, a projector using a light modulation device other than liquid crystal, such as a device using a micromirror, may be employed.

  In each of the above embodiments, the display system 1 including the projector 2 as a display device and the PCs 3 and 3A as image transmission devices is illustrated, but the present invention is not limited to this. In other words, the display device and the image transmission device may be other electronic devices. For example, various displays such as liquid crystal, plasma, organic EL (electroluminescence), and CRT (Cathode Ray Tube) can be employed as the display device. Further, as described above, the image transmission apparatus may be a desktop PC in which a computer main body and a display device that displays a screen during operation are separated.

  The present invention can be suitably used for a display system including a display device and an image transmission device.

  DESCRIPTION OF SYMBOLS 1 ... Display system, 2 ... Projector (display apparatus), 3, 3A ... PC (image transmission apparatus), 43 ... Display size acquisition part, 44 ... Layout area formation part, 46 ... Image selection part (selection part), 47 ... Graphic drawing unit (selection unit) 48... Image placement unit 50. Layout setting unit 54 and 54 A Data generation unit 55 Data transmission unit 503 Hierarchy setting unit 553 Change determination unit 554 Difference acquisition , 555... Packet generator (transmission data generator).

Claims (9)

An image transmission device that transmits image data of a display image to be displayed on a display device,
A selection unit for selecting an object constituting the display image;
A display size acquisition unit that acquires a display size of an image that can be displayed by the display device;
A layout region forming unit for forming a layout region according to the acquired display size;
An image placement unit for placing an image image corresponding to the object selected by the selection unit in the layout area;
A layout setting unit that sets a layout of the image of the object corresponding to the image image in the display image according to the image image arranged in the layout area;
A hierarchy setting unit for setting a hierarchy indicating a position from the back of the object;
Data generation for generating transmission data to be image data of the display image based on the layout in order from the object having the lower hierarchy set by the hierarchy setting unit among the image data of the selected object And
An image transmission device comprising: a data transmission unit configured to transmit the generated transmission data to the display device. The image transmission apparatus according to claim 1,
The data transmitter is
An image transmission apparatus that transmits the transmission data generated for each object by the data generation unit. The image transmission apparatus according to claim 1,
The data transmitter is
An image transmission apparatus that transmits the transmission data generated by the data generation unit for each screen of the display image. The image transmission apparatus according to claim 3.
The data generator is
It is determined whether the newly generated image data for one screen has changed with respect to the image data for one screen generated before the newly generated image data for one screen. A change determination unit;
When the change determination unit determines that there has been a change, difference image data that is a difference between the newly generated image data for one screen and the previously generated image data for one screen is obtained. A difference acquisition unit to acquire;
An image transmission apparatus comprising: a transmission data generation unit configured to generate the transmission data based on the difference image data. The image transmission apparatus according to claim 4,
The transmission data generation unit includes:
When the image formed by the difference image data is not rectangular, the difference image data is divided to generate a plurality of rectangular image data in which the formed image is rectangular, based on the rectangular image data, An image transmitting apparatus that generates the transmission data, respectively. The image transmission apparatus according to claim 4,
The transmission data generation unit includes:
When the image formed by the difference image data is not rectangular, an area not displayed on the display device is added to generate rectangular image data in which the formed image is rectangular, and based on the rectangular image data An image transmitting apparatus for generating the transmission data.   A display system comprising: the image transmission device according to claim 1; and a display device that displays a display image based on image data transmitted from the image transmission device. An image transmission program executed by an image transmission device that transmits image data of a display image to be displayed on a display device,
In the image transmission device,
A display size acquisition step of acquiring a display size of an image that can be displayed by the display device;
A layout region forming step for forming a layout region according to the acquired display size;
A selection step of selecting objects to be included in the display image;
An image placement step of placing an image image corresponding to the object selected in the selection step in the layout area;
A layout setting step of setting a layout of the image of the object corresponding to the image image in the display image according to the image image arranged in the layout area;
A hierarchy setting step for setting a hierarchy indicating a position from the back of the object;
Data generation for generating transmission data to be image data of the display image based on the layout in order from the object having the lower hierarchy set in the hierarchy setting step among the image data of the selected object Steps,
A data transmission step of transmitting the generated transmission data to the display device;
The image transmission program characterized by performing.   A recording medium in which the image transmission program according to claim 8 is recorded so as to be readable by a computer.

Images