JP2018163685A - Electronic apparatus and screen data transfer method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To transfer, to a projector, screen data displayed by using an application not having a screen transfer function.SOLUTION: A user terminal 1 comprises: a clip board 151 that stores an object content to be displayed by a projector 2; a rendering part 163 that, when the content is stored in the clip board 151, creates image data based on the content; a display control part 164 that displays, on a display part 13, screen data including at least part of the image data; a capturing part 165 that captures the screen data; and a transmission part 166 that transmits the captured screen data to the projector 2.SELECTED DRAWING: Figure 5

Description

  The present invention relates to an electronic device having a display screen, and a screen data transfer method from the electronic device to a display control device.

  2. Description of the Related Art A screen transfer system is used for transferring display screens of electronic devices such as smartphones and PCs (Personal Computers) to a display control device such as a projector or a display and displaying them on a screen or a display. Patent Document 1 discloses a system in which a portable information terminal renders content acquired from a Web server, transfers the rendered content to a projector, and the projector displays the content.

JP 2002-290605 A

  The process of causing the display control device to display the content screen displayed by the smartphone is realized by the smartphone executing an application program (hereinafter referred to as “screen transfer application”) that transfers the content screen to the display control device. The The smartphone captures the screen data displayed on the smartphone screen by executing the screen transfer application, and transfers the captured screen data to the display control device.

  However, some OSs (Operating Systems) of smartphones prohibit the application operating in the background state from capturing data displayed on the screen from the viewpoint of security. In order to cope with such an OS, it is conceivable to add a viewer function for rendering the content and displaying it on the screen in the screen transfer application. In this way, the user can display the content using the screen transfer application and transfer the displayed content to the display control apparatus.

  However, the user does not always want to use a screen transfer application for displaying content. For example, when a user uses a Web browser in which his / her favorite site is bookmarked as an application for displaying Web content, it is inconvenient and undesirable to display the content using a screen transfer application. .

  Therefore, the present invention has been made in view of the above-described points, and an object of the present invention is to enable screen data displayed using an application not having a screen transfer function to be transferred to a display control apparatus.

  In order to solve the above problems, an electronic device according to the present invention includes a storage unit that stores content to be displayed on a display control device, and the content is stored in a predetermined area of the storage unit. Image data generating means for generating image data based on the content, display control means for displaying on the display means screen data including at least a part of the image data generated by the image data generating means, and the screen data Capture means for capturing, and transmission means for transmitting the screen data captured by the capture means to the display control device.

  According to the present invention, it is possible to transfer screen data displayed using an application that does not have a screen transfer function to the display control device.

1 shows a configuration of a screen data transfer system S according to the present embodiment. It is a figure which shows the flow until it transfers the screen data of a display screen. It is a figure which shows the aspect in which the operation state of a screen transfer application changes. It is a figure which shows the flow until the web page displayed on the display screen is transmitted to a projector. 2 is a diagram illustrating a configuration of a user terminal 1. FIG. 2 is a diagram showing a configuration of a projector 2. FIG. 4 is a flowchart showing a processing procedure in the user terminal 1. 4 is a flowchart showing a processing procedure in the user terminal 1. It is a figure which shows an example of the screen data displayed on the user terminal. It is a figure which shows an example of the screen data displayed on the user terminal. It is a flowchart which shows the procedure of a 1st image generation process. It is a flowchart which shows the procedure of a 2nd image generation process.

[Overview of Screen Data Transfer System S]
FIG. 1 shows a configuration of a screen data transfer system S according to the present embodiment.

  The screen data transfer system S includes a user terminal 1 that is an electronic device used by a user, and a projector 2 that is a display control device that projects screen data sent from the user terminal 1. The user terminal 1 is a smartphone or a PC, for example, and includes a display screen.

  The user terminal 1 is preinstalled with an operating system, a web browser application, a screen transfer application, and the like. The projector 2 projects the screen data transferred from the user terminal 1 onto the screen 3. The user terminal 1 and the projector 2 are connected by a wireless communication line N such as a wireless LAN.

  FIG. 2 is a diagram showing a flow until the screen data displayed on the user terminal 1 is transferred to the projector 2. FIG. 3 is a diagram for explaining a mode in which the operation state of the application in the user terminal 1 changes. FIG. 4 is a diagram illustrating a flow until the screen data of the Web page displayed on the user terminal 1 is transferred to the projector 2.

  Hereinafter, a flow until the screen data in the user terminal 1 is transferred to the projector 2 will be described with reference to FIGS.

  First, the user activates the Web browser application to bring it into the foreground state, and displays a content display screen to be transferred to the projector 2 (S11). At this time, the screen transfer application of the user terminal 1 is in an unstarted state or a background state shown in FIG. A screen transfer application in the background state cannot capture the display screen.

  In this state, the user selects an entire area or a partial area of the screen displayed by the Web browser application, and performs an operation of copying the content in the selected area. Although FIG. 4 illustrates an operation in which the user copies a URL included in the displayed Web page, the user may copy a character string such as a URL received by the mail application. The content selected by the user is stored in the clipboard in the memory of the user terminal 1 (S12). When the user performs an operation of copying a URL, text data indicating the URL is stored in the clipboard.

  Next, the user activates the screen transfer application (S13). When the user activates the screen transfer application, “restart” in FIG. 3 is performed, and the screen transfer application that has not been activated or is in the background state in S11 and S12 transitions to the foreground state.

  When transitioning to the foreground state, the screen transfer application establishes a logical connection (hereinafter referred to as “communication link”) between the user terminal 1 and the projector 2 (S14). Subsequently, the screen transfer application generates image data based on the content stored in the clipboard (S15). In the example illustrated in FIG. 4, the screen transfer application accesses the Web page corresponding to the URL stored on the clipboard, and generates image data by acquiring HTML data of the Web page. Note that the method for generating image data differs depending on the type of content stored in the clipboard. Details of the method for generating image data will be described later.

  Next, the screen transfer application displays screen data including at least a part of the generated image data (S16). Specifically, the screen transfer application displays the screen data on the display of the user terminal 1 by storing the generated image data in the VRAM.

  Subsequently, the screen transfer application captures screen data (S17). Thereby, the Web page that is the screen data to be transferred to the projector 2 is stored in the transfer buffer in the memory of the user terminal 1. Subsequently, the screen transfer application transfers the screen data in the transfer buffer to the projector 2 (S18). The projector 2 projects the screen data transferred from the user terminal 1 onto the screen 3.

  As shown in FIG. 3, in the user terminal 1, when the user performs a pause operation while the screen transfer application is operating in the foreground state, or another application with a high priority such as an incoming call is started. In such a case, the screen transfer application transitions to the background state.

  Further, as shown in FIG. 3, when an abnormal state such as a memory shortage occurs in the user terminal 1 while the screen transfer application is operating in the background state, or when a forced termination operation is performed by the user, screen transfer is performed. The application transitions from the background state to the unstarted state. Further, the screen transfer application may transition to an unstarted state when a preset time has elapsed in the background state.

  As described above, in the user terminal 1 according to the present embodiment, even when it is prohibited to capture the display screen in the background state, the user can display on the display screen using an application such as a familiar web browser. It is possible to transfer the content thus made to the projector 2.

[Configuration of user terminal 1]
Next, the configuration of the user terminal 1 will be described.

  FIG. 5 is a diagram illustrating a configuration of the user terminal. The user terminal 1 includes an operation unit 11, a communication unit 12, a display unit 13, a VRAM 14, a storage unit 15, and a control unit 16. The control unit 16 includes an operation reception unit 161, a copy unit 162, a rendering unit 163, a display control unit 164, a capture unit 165, and a transmission unit 166.

  The operation unit 11 includes, for example, operation buttons or a touch panel. The operation unit 11 notifies the operation reception unit 161 of data indicating the content of the operation by the user. For example, the operation unit 11 notifies the operation reception unit 161 of coordinate data indicating a position where the user touches the touch panel overlaid on the display unit 13.

  The communication unit 12 is a communication interface for transmitting screen data to the projector 2. The communication unit 12 includes an antenna, an RF (Radio Frequency) unit, and a baseband unit, and transmits and receives packet data that conforms to a preset wireless LAN standard.

  The display unit 13 displays the screen data read from the VRAM 14 based on the control of the display control unit 164. The display unit 13 is, for example, a liquid crystal panel or an organic EL (Electro Luminescence) panel. A touch panel included in the operation unit 11 is overlaid on the display surface of the liquid crystal panel or the organic EL panel.

  The VRAM 14 stores screen data displayed on the display unit 13. Note that the RAM in the storage unit 15 may be used as the VRAM 14 if the access speed of a RAM included in the storage unit 15 described later is sufficiently high.

  The storage unit 15 is a storage medium such as a ROM, a RAM, and a flash memory. The ROM stores various programs (for example, a boot program, OS, and application program) executed by the control unit 16 and data such as parameters. The RAM is used as a work area when the control unit 16 executes a program and as a storage area for various data. For example, the RAM includes a clipboard 151 area and a transfer buffer 152 area, which are different storage areas. The clipboard 151 stores content data copied by the copy unit 162. Screen data acquired by the capture unit 165 is stored in the transfer buffer 152.

  The control unit 16 is a CPU, for example. The control unit 16 functions as an operation reception unit 161, a copy unit 162, a rendering unit 163, a display control unit 164, a capture unit 165, and a transmission unit 166 by executing a program stored in the storage unit 15. For example, while the web browser application other than the screen transfer application is operating in the foreground state, the control unit 16 operates as the operation reception unit 161 and the copy unit 162, so that the content selected by the user is stored in the clipboard 151. Store.

  The control unit 16 operates as a rendering unit 163, a display control unit 164, a capture unit 165, and a transmission unit 166 while the screen transfer application is operating in the foreground state. The control unit 16 captures, encodes, and transmits the screen data displayed on the display unit 13 until the user performs an operation for starting the screen transfer until the operation for stopping the screen transfer. The process is repeated each time it is detected that the screen data has changed.

  The operation reception unit 161 receives an operation input by the user via the operation unit 11. The operation reception unit 161 is, for example, data indicating an operation for selecting content such as a character string, URL, photo, video data, video file, and document file displayed on the display unit 13 and an operation for copying the selected content. Is acquired from the operation unit 11, and the operation content corresponding to the acquired data is specified. The operation reception unit 161 notifies each unit of the control unit 16 of an operation instruction indicating the specified operation content. For example, when acquiring data indicating an operation for copying content, the operation receiving unit 161 notifies the copy unit 162 of a copy operation instruction including coordinate data for specifying a region to be copied.

  The copy unit 162 operates as a storage control unit in cooperation with the operation accepting unit 161, and accepts an operation for the operation accepting unit 161 to store the content in the clipboard 151 in a state where the content is displayed on the display unit 13. The content is stored in the clipboard 151. Specifically, the copy unit 162 displays content including a specified character string, URL, photo, video data, video file, document file, and the like based on the operation content acquired through the operation reception unit 161 on the clipboard. 151. The copy unit 162 may cause the storage unit 15 to store the time when the content is stored in the clipboard 151.

  The rendering unit 163 is an image data generation unit that generates image data corresponding to the type of content. The rendering unit 163 can execute a plurality of types of rendering processing methods. For example, the rendering unit 163 acquires HTML of a Web page corresponding to a URL, generates a Web renderer (for example, a Web browser) that generates image data based on the acquired HTML, a document renderer that generates image data based on a document file, And operate as a multimedia renderer that generates image data based on photo files or video files. The rendering unit 163 executes rendering processing by selecting an appropriate rendering processing method from a plurality of types of rendering processing methods based on an instruction from the user or by identifying a content type.

  The rendering unit 163 identifies the type of content stored in the clipboard 151 by using, for example, a file format type, a data header, or a file extension. The rendering unit 163 determines that the content is a URL when the content is, for example, text data described in the URL notation format defined in RFC1738. When the content stored in the clipboard 151 is a URL, the rendering unit 163 activates a Web renderer to acquire HTML data corresponding to the URL, and generates Web page image data based on the acquired HTML data. To do.

  When the content stored in the clipboard 151 is a document file, the rendering unit 163 activates a document renderer and generates image data of the document file. When the content stored in the clipboard 151 is a photo file or a video file, the rendering unit 163 activates a multimedia renderer to generate image data of the photo file or the video file. The rendering unit 163 stores the generated image data in the storage unit 15.

  The rendering unit 163 monitors the state of the communication unit 12 and detects that a communication link is established between the projector 2 and the communication unit 12. The rendering unit 163 generates image data, for example, when content is stored in a predetermined area (for example, the clipboard 151) of the storage unit 15 while the communication link is established.

  The rendering unit 163 may perform rendering processing on the content in the clipboard 151 when the communication link between the projector 2 and the communication unit 12 is established in a state where the content is stored in the clipboard 151. In this case, the rendering unit 163 acquires the time when the content is stored in the clipboard 151 from the storage unit 15, and the image is displayed when a communication link is established before a predetermined time elapses after the content is stored in the clipboard 151. Data may be generated.

  For example, the predetermined time is 30 seconds. In this case, the rendering unit 163 determines that the content stored in the clipboard 151 20 seconds after the communication connection is established is the content to be transferred to the projector 2. On the other hand, for example, when content copied 30 minutes ago is stored in the clipboard 151, the rendering unit 163 determines that this content is not the content to be transferred. By doing so, it is possible to prevent screen data that the user does not want to transfer from being transferred to the projector 2.

  The display control unit 164 causes the display unit 13 to display the screen data by storing the screen data including at least a part of the image data generated by the rendering unit 163 in the VRAM 14. For example, the display control unit 164 cuts out image data corresponding to an area specified by a user operation from the image data stored in the storage unit 15 and stores the cut-out image data in the VRAM 14 to display the screen data. Data is displayed on the display unit 13. Note that the rendering unit 163 may have the function of the display control unit 164.

  The capture unit 165 captures the screen data stored in the VRAM 14 by storing it in the transfer buffer 152. The capture unit 165 may store screen data of a predetermined area in the transfer buffer 152 among the screen data stored in the transfer buffer 152. Note that the capture unit 165 may capture the screen data continuously at a predetermined interval, or may capture the screen data when receiving an instruction from the user to transfer the screen data to the projector 2.

  The transmission unit 166 establishes a communication link with the projector 2 via the communication unit 12. When the transmission unit 166 receives an instruction from the user to transfer the screen data to the projector 2 in a state where the communication link is established, the transmission unit 166 transmits the screen data stored in the transfer buffer 152 to the projector 2. Specifically, the transmission unit 166 encodes the screen data stored in the transfer buffer 152 by the capture unit 165 using, for example, the JPEG encoding method, and transmits the encoded screen data to the projector 2.

  Note that the processing method of encoding the screen data by the transmission unit 166 is arbitrary. For example, when it is detected that the screen data has changed, the screen data may be encoded. In addition, when the user performs an operation to stop the screen transfer, the transmission unit 166 stops the screen data encoding process and the transmission process to the projector 2.

[Configuration of Projector 2]
Next, the configuration of the projector 2 will be described.

  FIG. 6 is a diagram showing the configuration of the projector 2. The projector 2 includes an operation unit 21, a communication unit 22, a projection unit 23, a VRAM 24, a storage unit 25, and a control unit 26. The control unit 26 includes an operation reception unit 261, an acquisition unit 262, a decoder 263, and a projection control unit 264.

  The operation unit 21 includes, for example, a power button and a remote control reception unit that receives a user operation from a remote controller (not shown) and receives an input operation from the user.

  The communication unit 22 is a communication interface for receiving screen data from the user terminal 1. The communication unit 22 establishes and disconnects a communication link with the user terminal 1 in accordance with a user operation.

  The projection unit 23 includes a liquid crystal panel, a lens, and a light source. The projection unit 23 projects the screen data read from the VRAM 24 onto the screen 3 under the control of the projection control unit 264.

  The VRAM 24 stores screen data projected on the screen 3.

  The storage unit 25 is a storage medium such as a ROM, a RAM, and a flash memory. The storage unit 25 stores a program executed by the control unit 26.

  The control unit 26 is a CPU, for example. The control unit 26 functions as an operation reception unit 261, an acquisition unit 262, a decoder 263, and a projection control unit 264 by executing a program stored in the storage unit 25.

  The operation receiving unit 261 receives the operation content input by the user via the operation unit 21 and notifies the operation content to each unit of the control unit 26.

  The acquisition unit 262 acquires the screen data received by the communication unit 22 from the user terminal 1 and inputs the acquired screen data to the decoder 263. The acquisition unit 262 may store the acquired screen data in the storage unit 25 and input the screen data to the decoder 263 via the storage unit 25.

  The decoder 263 decodes the screen data input from the acquisition unit 262. The decoder 263 may change the image size of the screen data to a desired size by performing a scaling process.

  The projection control unit 264 stores the screen data decoded by the decoder 263 in the VRAM 24. Further, the projection control unit 264 controls the projection unit 23 to project the screen data stored in the VRAM 24 onto the screen 3. Note that the decoder 263 may have the function of the projection control unit 264.

[Process in which user terminal 1 displays screen data on projector 2]
Next, a process in which the user displays screen data on the projector 2 will be described.

  FIG. 7 is a flowchart illustrating a processing procedure until the content specified by the user on the user terminal 1 is displayed on the display unit 13. FIG. 8 is a flowchart showing a processing procedure until the content image displayed on the display unit 13 is transferred to the projector 2. 9 and 10 show examples of screens displayed on the user terminal 1 by the screen transfer application. Hereinafter, with reference to FIGS. 7 to 10, a process until the content specified by the user in the user terminal 1 is transferred to the projector 2 will be described.

  First, the process until the screen data to be transferred to the projector 2 is displayed on the display unit 13 will be described with reference to the flowchart shown in FIG.

  The control unit 16 causes the screen transfer application to transition to the foreground state in the user terminal 1 based on the user's operation for starting the screen transfer application (S21). When the screen transfer application is shifted to the foreground state, the control unit 16 determines whether or not a communication link with the projector 2 is established (S22). If the communication link with the projector 2 is established (YES in S22), the control unit 16 transitions to S24.

  When the communication link is not established (NO in S22), the control unit 16 displays a projector selection screen for the user to select the projector 2 that projects the screen data, as shown in FIG. 9A. To display. When the user performs an operation of selecting the projector 2 for displaying the screen data, the control unit 16 establishes a communication link between the user terminal 1 and the selected projector 2 (S23).

  Subsequently, the control unit 16 determines whether or not the clipboard 151 includes content stored within a predetermined time (S24). When the clipboard 151 includes content stored within a predetermined time (YES in S24), the rendering unit 163 performs rendering processing on the content stored in the clipboard 151, and the display unit 13 The image data to be displayed is generated (S25).

  When the clipboard 151 does not include content stored within a predetermined time (NO in S24), the control unit 16 causes the user to select content to be displayed on the display unit 13. Then, the rendering unit 163 performs rendering processing on the selected content, and generates image data to be displayed on the display unit 13 (S26). The details of the first image data generation process (S25) and the second image data generation process (S26) will be described later with reference to FIGS.

  Subsequently, the control unit 16 stores the image data in the VRAM 14 and causes the display unit 13 to display screen data including at least a part of the image data (S27). As illustrated in FIGS. 10A and 10B, the control unit 16 causes the display unit 13 to display screen data corresponding to the content type. FIG. 10A shows a screen in which the control unit 16 displays the image data generated by the document renderer on the display unit 13 using the document viewer in the screen transfer application. FIG. 10B shows a screen on which the control unit 16 causes the display unit 13 to display the image data generated by the Web renderer using a Web browser in the screen transfer application.

  Next, the procedure of the screen transfer process will be described along the flowchart shown in FIG. FIG. 8 is a flowchart showing a flow from when the screen data in the user terminal 1 is captured until the screen transfer application ends.

  Following S27 in FIG. 7, the control unit 16 captures the screen data stored in the VRAM 14 (S31). Subsequently, as illustrated in FIG. 10C, the control unit 16 displays an operation image 110 for the user to instruct start / stop of the screen transfer process. When the user touches the operation image 110 to acquire an instruction to start the screen transfer process (YES in S32), the control unit 16 starts the screen data transfer process, and transfers the transfer buffer. The screen data stored in 152 is transferred to the projector 2 (S33).

  During the screen data transfer process, the control unit 16 repeats the screen transfer process until the user touches the operation image 110 and gives an instruction to stop the screen data transfer. When the user touches the operation image 110 during the screen data transfer process (YES in S34), the control unit 16 stops the screen transfer process and whether there is a change in the content to be transferred. A dialog screen on which can be selected is displayed on the display unit 13 (S35).

  When there is a change in the content to be transferred to the projector 2 (YES in S35), the control unit 16 transitions to S24 in FIG. 7 and whether or not the content stored in the clipboard 151 within the predetermined time is included. Determine. At this time, the user can perform an operation of copying a content to be transferred to the projector 2 to the clipboard 151 by setting a screen transfer application such as a Web browser application in the foreground state.

  If there is no change in the content to be transferred to projector 2 (NO in S35), control unit 16 waits for an instruction to disconnect the communication link with projector 2 (S36). If an instruction to disconnect the communication link with projector 2 is input (YES in S36), control unit 16 disconnects the communication link with projector 2 and moves the process to S23 in FIG. When the instruction to disconnect the communication link is not input (NO in S36), the control unit 16 transitions to S37 and waits for an instruction to end the screen transfer application. For example, the control unit 16 displays a dialog screen on the display unit 13 that allows the user to select whether or not to terminate the screen transfer application.

  Here, when the instruction to end the screen transfer application is not input (NO in S37), the control unit 16 moves the process to S32. When the end of the screen transfer application is selected by the user (YES in S37), the control unit 16 ends the screen transfer application and transitions the screen transfer application to the unstarted state.

  Next, details of the first image generation process (S25) in FIG. 7 will be described with reference to FIG. FIG. 11 is a flowchart showing the procedure of the first image generation process (S25).

  First, the rendering unit 163 determines the type of content (S25-1). If the rendering unit 163 determines that the content is a document file including text information based on the data header or extension of the content, the rendering unit 163 activates a document renderer (S25-2). If the rendering unit 163 determines that the content is a URL, the rendering unit 163 activates a Web renderer (S25-3).

  When the rendering unit 163 determines that the content is multimedia data such as a photo and a moving image based on the data header or extension of the content, the rendering unit 163 activates the multimedia renderer (S25-4). The rendering unit 163 generates image data using each activated renderer (S25-5). The rendering unit 163 stores the generated image data in the VRAM 14 (S25-6). In this way, if the content is copied to the clipboard within a predetermined time, an appropriate renderer is automatically selected and the content is transferred to the projector 2 even if the user does not select a renderer. Of course, after the renderer is automatically selected, it is also possible to display a guidance for prompting the user to confirm.

  Note that when the plurality of contents stored within a predetermined time are included in the clipboard 151, the control unit 16 as shown in FIG. 9B instead of the process of determining the content type in S25-1. In addition, a screen for selecting a content to be transferred to the projector 2 from a plurality of contents in the clipboard may be displayed on the display unit 13. In this case, the rendering unit 163 generates image data based on the selected content in response to an instruction for selecting the content. In addition, when a plurality of contents stored within a predetermined time are included in the clipboard 151, the control unit 16 causes the clipboard 151 to display a screen for accepting an instruction to select the content on the display unit 13. Of the plurality of stored contents, the latest content stored may be selected.

  Next, details of the second image generation process (S26) in FIG. 7 will be described with reference to FIG. FIG. 11 is a flowchart showing the procedure of the second image generation process (S26).

  First, the display control unit 164 causes the display unit 13 to display a screen for receiving an instruction to select content to be transferred to the projector 2. For example, an operation screen as shown in FIG. 9C is displayed on the display unit 13 (S26-1). When the user selects “document” on the operation screen shown in FIG. 9C, the rendering unit 163 activates the document renderer (S26-2). When the user selects “Web” on the operation screen illustrated in FIG. 9C, the rendering unit 163 activates the Web renderer (S26-2). When the user selects “Photo / Video” on the operation screen shown in FIG. 9C, the rendering unit 163 activates the multimedia renderer (S26-2).

  The rendering unit 163 generates image data using each activated renderer (S26-5). The rendering unit 163 stores the generated image data in the VRAM 14 (S26-6). In this way, the user can select desired content and transfer it to the projector 2.

[Effect in this embodiment]
As described above, in the screen data transfer system S according to the present embodiment, the screen transfer application in the user terminal 1 generates image data based on the content stored in the clipboard 151, and at least a part of the image data. Is captured and transferred to the projector 2. By doing in this way, even if there is a restriction that the application in the background state cannot capture the screen, the user terminal 1 uses the renderer such as a familiar web browser that does not have a screen transfer function. The screen data displayed by can be easily transferred to the projector 2.

  As mentioned above, although this invention was demonstrated using embodiment, the technical scope of this invention is not limited to the range as described in the said embodiment, A various deformation | transformation and change are possible within the range of the summary. is there. For example, in the above embodiment, the user terminal 1 and the projector 2 are connected by the wireless communication line N. However, the user terminal 1 and the projector 2 are connected by a wired communication line. May be. In the above embodiment, the case where the display control device is the projector 2 has been described. However, the display control device may be a display having a liquid crystal panel or the like.

DESCRIPTION OF SYMBOLS 1 User terminal 2 Projector 15 Memory | storage part 163 Rendering part 164 Display control part 165 Capture part 166 Transmission part

In order to solve the above problems, an electronic device according to the present invention is an electronic device that can capture screen data displayed on a display unit and transfer it to a display control device by executing a screen transfer application. Storage means for storing content, image data generation means for generating image data based on the content stored in the storage means, and the screen data including at least a part of the image data in the display means Display control means for displaying, and the image data generation means generates the image data when a user starts or restarts the screen transfer application in a state where the content is stored in the storage means. It is characterized by doing.

Claims (15)

Storage means for storing content to be displayed on the display control device;
Image data generating means for generating image data based on the content when the content is stored in a predetermined area of the storage means;
Display control means for causing the display means to display screen data including at least a part of the image data generated by the image data generation means;
Capture means for capturing the screen data;
Transmitting means for transmitting the screen data captured by the capture means to the display control device;
An electronic device comprising: The image data generation unit generates the image data when a communication link is established between the transmission unit and the display control device in a state where the content is stored in a predetermined area of the storage unit. Characterized by the
The electronic device according to claim 1. The image data generation means generates the image data when the communication link is established before a predetermined time has elapsed since the content is stored in the storage means.
The electronic device according to claim 2. The image data generation means is configured to store the image data when the content is stored in the predetermined area of the storage means while a communication link is established between the transmission means and the display control device. Is characterized by generating
The electronic device of any one of Claim 1 to 3. The image data generation means, when a plurality of different contents are stored in the predetermined area of the storage means, the image data based on the one content selected based on an instruction to select content Characterized by generating,
The electronic device of any one of Claim 1 to 4. The image data generation means generates the image data using a rendering means corresponding to the content type,
The electronic device according to claim 1. The transmission means transmits the screen data to the display control device in response to receiving an instruction to transmit the screen data captured by the capture means.
The electronic apparatus of any one of Claim 1 to 6. Storage control means for storing the content in the predetermined area of the storage means when an operation for storing the content in the storage means is received in a state where the content is displayed on the display means. Characterized by having,
The electronic device of any one of Claim 1 to 7.   A computer-executable program for causing a computer to function as each unit of the electronic device according to any one of claims 1 to 8. A screen data transfer method for transmitting screen data from an electronic device to a display control device,
Executed in the electronic device,
Storing content to be displayed on the display control device in a predetermined area of a storage unit of the electronic device;
When the content is stored in a predetermined area of the storage means, generating image data based on the content;
Displaying screen data including at least a part of the image data on a display means;
Capturing the screen data after the screen data is displayed on the display means;
Transmitting the captured screen data to the display control device;
A screen data transfer method characterized by comprising: Further comprising establishing a communication link between the electronic device and the display control device;
In the step of generating the image data, the image data is generated on the condition that the step of establishing the communication link is executed in a state where the content is stored in a predetermined area of the storage unit. Characterized by the
The screen data transfer method according to claim 10. In the storing step, the time when the content is stored in the predetermined area of the storage unit is stored in the storage unit,
In the step of generating the image data, the image data is generated when the communication link is established before a predetermined time elapses from the time stored in the storage unit.
The screen data transfer method according to claim 11. A step of displaying a selection screen for selecting one content from the plurality of contents stored in the predetermined area of the storage means;
In the step of generating the image data, the image data based on the one content selected on the selection screen is generated.
The screen data transfer method according to any one of claims 10 to 12. The step of generating the image data includes:
Identifying the type of the content stored in the predetermined area of the storage means;
Selecting a rendering means corresponding to the type of content identified from a plurality of rendering means;
Generating the image data using the selected rendering means;
It is characterized by having
The screen data transfer method according to claim 10. After the step of displaying, the display unit further includes a step of displaying a screen for inputting an instruction as to whether or not to transmit the displayed screen data to the display control device,
In the transmitting step, the screen data is transmitted to the display control device in response to receiving an instruction to transmit the screen data.
The screen data transfer method according to any one of claims 10 to 14.