JP2014212484A - Display control device, control method for display control device, program, and recording medium - Google Patents

Abstract

PROBLEM TO BE SOLVED: To effectively utilize a display screen of a display device.SOLUTION: A smartphone (1) comprises: a screen resolution acquisition unit (20) that acquires a screen resolution (M1) of a display device (100); and a screen data generation unit (21) that includes content video (51) in screen data (M2), includes a control UI (41) in an area other than the content video (51) in the screen data (M2) on the basis of the screen resolution (M1), transmits the result to the display device (100), and causes the result to be displayed.

Description

  The present invention relates to a display control device or the like that outputs and displays content on a display device.

  There are various techniques for outputting and displaying content on an external display device. In recent years, a technology called Miracast (registered trademark) for transmitting a display screen of a mobile phone, a smartphone, a personal computer, or the like to a television receiver has been proposed.

  However, if the content is displayed on the display device as it is, there is a possibility that a useless margin other than the content may be generated on the display screen. This is because the aspect ratio does not match between the content and the display device. As techniques for reducing such margins, the following patent documents 1 and 2 have been proposed.

  Patent Document 1 discloses a technique in which, among a plurality of images acquired by an electronic camera, two vertically long images are arranged and only one horizontally long image is displayed on a television monitor.

  Patent Document 2 discloses a technique in which a part of an image recorded by a camera is cut out and displayed on an external display device so that the left and right margins of the screen are reduced.

JP 2006-109360 A (published April 20, 2006) JP 2007-336515 A (published on December 27, 2007)

  However, the technique disclosed in Patent Document 1 merely outputs two images to a television monitor, and does not generate screen data for displaying on the television monitor. Therefore, even if the technique of Patent Document 1 is applied, there is still a problem that a blank space remains in an area other than the two displayed images.

  Moreover, since the technique of patent document 2 cuts out and displays a part of an image, there is a problem that the displayed image is displayed in a state in which a part is missing.

  The present invention has been made in view of the above-described problems, and an object thereof is to provide a display control device and the like that can effectively use the display screen of the display device.

  In order to solve the above problems, a display control device according to one embodiment of the present invention generates a display image having a resolution equal to a screen resolution of a display screen included in the display device, and the display image is stored in the display device. A display control device for transmitting and displaying on the display screen of the display device, the acquisition means for acquiring the screen resolution of the display screen of the display device, and including the first content in the display image First content adding means, and second content adding means for including the second content in an area other than the first content in the display image based on the screen resolution acquired by the acquiring means.

  The display control device control method according to an aspect of the present invention generates a display image having a resolution equal to the screen resolution of a display screen included in the display device, transmits the display image to the display device, and A method for controlling a display control device to be displayed on the display screen included in a display device, the acquisition step of acquiring the screen resolution of the display screen included in the display device, and a first content including first content in the display image And a second content adding step of including the second content in an area other than the first content in the display image based on the screen resolution acquired in the acquiring step.

  According to one aspect of the present invention, there is an effect that the display screen of the display device can be effectively used.

It is a functional block diagram which shows the principal part structure of the screen transmission system which concerns on one Embodiment of this invention. It is the figure which enumerated the pattern of the screen data produced | generated by the smart phone which concerns on the said embodiment, (a) is a figure in which both a display screen and a content image show a vertically long pattern, (b) and (c) FIG. 7 is a diagram showing a pattern in which the display screen is vertically long and the content video is horizontally long, (d) and (e) are diagrams in which the display screen is horizontally long and the content video is vertically long, and FIG. It is a figure in which both images show a horizontally long pattern. It is a figure which shows the example of a display of control UI (User Interface) included in the said screen data, (a) is a figure which shows vertically long control UI, (b) is a figure which shows horizontally long control UI. It is a figure for demonstrating the scaling process performed when a content image | video is included in the said screen data. It is a sequence diagram which shows an example of the flow of the process performed in the said screen transmission system. It is a figure which shows the screen data produced | generated by the smart phone which concerns on other embodiment of this invention.

Embodiment 1
Hereinafter, an embodiment of the present invention will be described in detail with reference to FIGS.

[Configuration of Screen Transmission System 1000]
FIG. 1 is a functional block diagram showing a main configuration of a screen transmission system 1000 according to the present embodiment. As illustrated, the screen transmission system 1000 includes a smartphone (display control device) 1 and a display device 100. The smartphone 1 and the display device 100 are communicably connected, and can transmit and receive various data. This communication is realized by, for example, Wi-Fi (registered trademark) communication, but is not limited thereto.

  Hereinafter, an outline of processing executed in the screen transmission system 1000 will be described.

  First, the display device 100 transmits the screen resolution M1 of the display screen of the device itself to the smartphone 1.

  The smartphone 1 generates screen data M2 having the same resolution as the received screen resolution M1. The screen data M2 includes a content video 51 being played back by the smartphone 1. Further, a blank area other than the content video 51 includes a control UI 41 for performing playback control of the content video 51.

  Then, the smartphone 1 transmits the generated screen data M2 to the display device 100.

  The display device 100 receives the screen data M2 and displays it on the display screen. Thereby, the content video 51 and the control UI 41 being reproduced by the smartphone 1 are displayed on the display screen of the display device 100.

  As described above, the smartphone 1 according to the present embodiment generates the screen data M2 to be displayed on the display screen of the display device 100. The blank area excluding the content video 51 in the screen data M2 is filled with the control UI 41. Therefore, since the smartphone 1 can display a screen with a reduced margin on the display device 100, the display screen of the display device 100 can be used effectively.

  Furthermore, since the smartphone 1 acquires the screen resolution M1 of the display screen included in the display device 100 and generates screen data M2 having a resolution equal to the screen resolution M1, the display is displayed on the display device 100 having an arbitrary resolution. A display screen corresponding to the device 100 can be generated.

[Configuration of smartphone 1]
Next, the configuration of the smartphone 1 will be described in detail with reference to FIG.

  In addition, the apparatus connected with the display apparatus 100 which concerns on this embodiment is not limited to such a smart phone, It is applicable to all the information processing apparatuses provided with the function which transmits an image to the display apparatus 100. FIG. For example, instead of the smartphone 1, a mobile phone, a personal computer, a tablet PC, a camera, a DVD (Digital Versatile Disc) player, a BD (Blu-ray (registered trademark) Disc) player, an STB (Set Top Box) for cable television, and the like Can be widely used.

  As illustrated, the smartphone 1 includes a control unit 10 and a storage unit 11. Furthermore, although not shown, the smartphone 1 may have various functions that are normally provided in the smartphone, such as a touch panel, an audio input unit, an audio output unit, a broadcast image receiving unit, and a GPS (Global Positioning System) receiving unit. . In addition, transmission / reception of data to / from the display device 100 is performed via a communication unit (not shown) built in the smartphone 1.

  The storage unit 11 includes a nonvolatile storage device such as an HDD (Hard Disc Drive) or a flash memory, and stores content information 40 and a control UI 41. The storage unit 11 may further include a volatile storage area such as a RAM (Random Access Memory). This area is used as a work area for temporarily storing data used for calculation, calculation results, and the like in the course of various processes executed by the control unit 10.

  The content information 40 includes a content resolution 50 and a content video 51. The content resolution 50 is the resolution of the content video 51 (the number of horizontal pixels × the number of vertical pixels). The content video 51 is entity data of video content, and is recorded in a format that can be played back by the smartphone 1. However, the content information 40 is not limited to such video content, and may be image content, music content including images, and the like.

  The control UI 41 is a user interface for performing playback control of the content video 51. Details of the control UI 41 will be described later.

  The control unit 10 controls the smartphone 1 as a whole and can be configured by a CPU (Central Processing Unit) or the like. The control unit 10 includes a screen resolution acquisition unit 20, a screen data generation unit 21, a content reproduction unit 22, and an operation signal acquisition unit 23 as functional blocks.

  The screen resolution acquisition unit 20 acquires the screen resolution M1 from the display device 100 and outputs it to the screen data generation unit 21 when the connection with the display device 100 is started. The screen resolution M1 is the resolution (the number of horizontal pixels × the number of vertical pixels) of the display screen (hereinafter simply referred to as “display screen”) included in the display unit 112 of the display device 100.

  The screen data generation unit 21 generates screen data M2 according to a procedure to be described later, and transmits it to the display device 100 for display. Further, the screen data generating unit 21 matches the resolution of the screen data M2 with the screen resolution M1. Therefore, the display device 100 can display the screen data M2 transmitted from the smartphone 1 as it is on the display screen without performing processing such as scaling.

  The screen data generation unit 21 further includes a direction determination unit 30 and a scaling processing unit 31.

  Based on the screen resolution M1 and the content resolution 50, the direction determination unit 30 matches the direction of the display screen (hereinafter referred to as the display direction 130) and the direction of the content video 51 (hereinafter referred to as the content direction). It is determined whether or not. Furthermore, when the display direction 130 and the content direction match, the direction determination unit 30 determines whether the vertical resolution and the horizontal resolution match between the screen resolution M1 and the content resolution 50. Determine. These determination results are used by the scaling processing unit 31 and the screen data generation unit 21.

  The display direction 130 is information indicating whether the display screen is in portrait orientation or landscape orientation. Here, “vertical” indicates that the long side direction of the display screen is vertical as viewed from the user (that is, the display screen is vertically long). On the other hand, “landscape” indicates that the long side direction of the display screen is horizontal when viewed from the user (that is, the display screen is horizontally long). The smartphone 1 may acquire the display direction 130 from the display device 100. Alternatively, the display direction 130 may be specified based on the ratio (aspect ratio) of the number of vertical and horizontal pixels indicated by the screen resolution M1.

  The content direction indicates whether the content video 51 is vertically or horizontally. The direction determination unit 30 may obtain the content direction based on the ratio (aspect ratio) of the number of pixels in the vertical and horizontal directions indicated by the content resolution 50. If the content information 40 includes content direction information, the information is used. May be.

  The scaling processing unit 31 performs scaling processing on the content video 51 being reproduced by the content reproduction unit 22. Specifically, the scaling processing unit 31 determines that at least one resolution (number of pixels) in the long side direction and the short side direction of the content video 51 is at least one resolution (pixels) in the long side direction and the short side direction of the display screen. Until it reaches (number), it scales in the long side direction and the short side direction at the same magnification. However, when the direction determination unit 30 determines that the vertical resolution and the horizontal resolution match between the screen resolution M1 and the content resolution 50, the scaling processing unit 31 omits the scaling processing. it can.

  FIG. 4 is a diagram illustrating an example of the scaling process executed by the scaling processing unit 31. In the figure, the number of vertical pixels of the content video 51 is X, the number of horizontal pixels is Y, the number of horizontal pixels of the display screen (screen data M2) is L, and the number of vertical pixels is M + N. As is clear from the figure, the content video 51 is in landscape orientation and the display screen is in portrait orientation. The size relationship between the number of pixels on each side is L> Y and M + N> X.

  In this case, the scaling processing unit 31 displays the content video 51 vertically and horizontally until the number of pixels Y in the horizontal direction (long side direction) of the content video 51 reaches the number of pixels L in the horizontal direction (short side direction) of the display screen. Magnify at double. As a result, the content video 51 is enlarged to the full width of the display screen while maintaining the aspect ratio, as shown.

  Further, the screen data generation unit 21 performs a first composition process for pasting the content video 51 on which the scaling process has been performed by the scaling process unit 31 to the blank screen data M2. Here, “pasting” refers to overwriting the pixel value of the blank screen data M2. The blank screen data M2 is an image having a resolution equal to the screen resolution M1, and a predetermined initial value (for example, a value indicating black) is set for each pixel value. As described above, since the content video 51 is scaled to the size of the full width or full height of the display screen, the corresponding region in the blank screen data M2 is the pixel of the content video 51 by the first combining process. It will be overwritten with the value.

  Note that the position in the blank screen data M2 where the content video 51 is pasted is not particularly limited. Hereinafter, when the content video 51 is in landscape orientation, the content video 51 is pasted so as to be in contact with the upper side or the lower side of the blank screen data M2. Similarly, when the content video 51 is vertically oriented, it is pasted so as to be in contact with the left side or the right side of the blank screen data M2. For example, in the example shown in FIG. 4, the content video 51 is pasted so as to be in contact with the upper side of the blank screen data M2.

  Further, when the direction determination unit 30 determines that the display direction 130 and the content direction are different, the screen data generation unit 21 displays the control UI 41 read from the storage unit 11 in an area other than the content video 51 in the screen data M2 ( A second synthesis process is performed for pasting to the margin area.

  The control UI 41 is a user interface (control control panel) for the user to instruct control of the playback operation of the content video 51. The control UI 41 includes display information and control information M3.

  FIGS. 3A and 3B are diagrams illustrating display examples of the control UI 41. FIG. As shown in the figure, the control UI 41 is prepared in a portrait (vertically long) and landscape (landscape) orientation. In the figure, the control UI 41 includes a playback time 200, a rewind key 201, a fast-forward key 202, a playback key 203, a previous content key 204, a next content key 205, and a stop key 206.

  Further, as shown in FIG. 3B, the horizontal control UI 41 further includes a seek bar 210 indicating the current playback position of the content video 51. Thus, the control UI 41 may change the items to be displayed according to the direction (vertical or horizontal). Note that the display form of the control UI 41 is not limited to the example illustrated in FIG. 3. For example, when the content information 40 is image content, music content including images, the control UI 41 is a display suitable for controlling them. It becomes a form.

  FIG. 2 is a diagram listing the patterns of the screen data M2 generated by the screen data generation unit 21. In the figure, all combinations of patterns when the content video 51 and the screen data M2 (display screen) are vertically or horizontally are shown.

  FIG. 2A shows a pattern in which the content video 51 and the screen data M2 are both vertically oriented. In this case, since both directions coincide, the screen data generation unit 21 does not perform the second synthesis process. That is, the control UI 41 is not added to the screen data M2. Therefore, as shown in the figure, the content video 51 occupies most of the area of the screen data M2. In particular, when the content resolution 50 matches the screen resolution M1, the content video 51 is pasted on the entire screen data M2.

  2B and 2C show patterns in which the content video 51 is horizontally oriented and the screen data M2 is vertically oriented. In this case, since the screen data generation unit 21 performs the second combining process, the control UI 41 is added to the screen data M2. Further, since the margin area of the content video 51 is horizontally long, a horizontal control UI 41 shown in FIG. 3B is pasted.

  In FIG. 2B, since the content video 51 is arranged on the upper side of the screen data M2, the control UI 41 is arranged on the lower side of the screen data M2. On the other hand, in FIG. 2C, since the content video 51 is arranged below the screen data M2, the control UI 41 is arranged above the screen data M2. As described above, in the cases of (b) and (c) in FIG. 2, the control UI 41 is arranged in a region on the opposite side to the content video 51.

  2D and 2E show patterns in which the content video 51 is vertically oriented and the screen data M2 is horizontally oriented. In this case, since the screen data generation unit 21 performs the second combining process, the control UI 41 is added to the screen data M2. Also, since the margin area of the content video 51 is vertically long, a vertically oriented control UI 41 shown in FIG.

  In FIG. 2D, since the content video 51 is arranged on the left side of the screen data M2, the control UI 41 is arranged on the right side of the screen data M2. On the other hand, in FIG. 2E, the content video 51 is arranged on the right side of the screen data M2, so the control UI 41 is arranged on the left side of the screen data M2. As described above, in the cases of (d) and (e) in FIG. 2, the control UI 41 is arranged in a region on the opposite side to the content video 51.

  FIG. 2F shows a pattern in which both the content video 51 and the screen data M2 are in the horizontal direction. In this case, since both directions coincide, the screen data generation unit 21 does not perform the second synthesis process. That is, the control UI 41 is not added to the screen data M2. Therefore, as shown in the figure, the content video 51 occupies most of the area of the screen data M2. In particular, when the content resolution 50 matches the screen resolution M1, the content video 51 is pasted on the entire screen data M2.

  It is preferable that the screen data generation unit 21 pastes the control UI 41 on the screen data M2 after expanding / contracting the control UI 41 according to the size of the margin area. For example, in the case shown in FIG. 2B, the blank area of the content video 51 changes in the vertical direction according to the aspect ratio of the content video 51. Therefore, in this case, the control UI 41 only needs to be able to expand and contract in the vertical direction. However, at least each key of the control UI 41 is desirably displayed in the blank area.

  Further, the screen data generation unit 21 may paste the control UI 41 only when a blank area other than the content video 51 in the screen data M2 exceeds a predetermined size. Accordingly, since the control UI 41 is not added when the margin area is small, it is possible to avoid a situation in which the control UI 41 is too small to be visually recognized or a part of the control UI 41 is missing. Furthermore, since the second synthesis process for pasting the control UI 41 can be omitted, the screen data M2 can be generated in a short time.

  Further, the information pasted in the blank area other than the content video 51 in the screen data M2 is not limited to the control UI 41 described above, and may be, for example, an indicator indicating the playback state of the content video 51.

  The control information M3 of the control UI 41 is information necessary for the display device 100 to accept a user instruction to the control UI 41. For example, the control information M3 is information in which coordinate information indicating the position of each key of the control UI 41 pasted on the screen data M2 is associated with a reproduction control command indicated by the key. This playback control command is information for instructing playback control of the content video 51 such as “rewind”, “fast forward”, “play”, and “stop”. The screen data generation unit 21 transmits the screen data M2 generated according to the above-described series of procedures to the display device 100 to be displayed on the display screen, and transmits control information M3 to the display device 100.

  It is desirable that the screen data generation unit 21 generates the screen data M2 in real time and transmits it to the display device 100 while acquiring the content video 51 being played back by the content playback unit 22.

  The content reproduction unit 22 reproduces the content video 51 read from the storage unit 11. The content video 51 being played back by the content playback unit 22 is output to the screen data generation unit 21. In addition, the reproduction operation in the content reproduction unit 22 is controlled based on an instruction from the operation signal acquisition unit 23.

  The content playback unit 22 has a function of presenting the content video 51 being played back to the user via a display unit (not shown) and an audio output unit (not shown) built in the smartphone 1. Also good. When the smartphone 1 further includes a function of rotating the display screen of the own device according to the attitude of the own device, the content direction matches the direction of the display screen of the smartphone 1. Note that a display unit included in the smartphone 1 may also display a user interface for controlling the playback operation of the content video 51 on the smartphone 1 side.

  The timing at which the content playback unit 22 starts to play back the content video 51 is not particularly limited. For example, after the connection between the smartphone 1 and the display device 100 is established, a plurality of content videos 51 held by the smartphone 1 by a user operation via a touch panel (display unit; not shown) built in the smartphone 1. Among them, when a specific content video 51 is selected, the reproduction of the content video 51 may be started. Alternatively, the reproduction of the content video 51 may be started based on an instruction from the operation signal acquisition unit 23.

  The operation signal acquisition unit 23 acquires the operation signal M4 from the smartphone 1, and instructs the control of the reproduction operation of the content video 51 reproduced by the content reproduction unit 22 based on the acquired operation signal M4. . The operation signal M4 is a signal including the reproduction control command. For example, when the reproduction control command included in the operation signal M4 is “rewind”, the operation signal acquisition unit 23 notifies the content reproduction unit 22 of this. Upon receiving this notification, the content playback unit 22 rewinds the content video 51 being played back for a predetermined time. The screen data generation unit 21 generates screen data M2 based on the content video 51 that has been rewound.

  The display device 100 to which the smartphone 1 is connected is not limited to a specific one. That is, the smartphone 1 can switch the connection destination to another display device 100. Since the smartphone 1 can acquire the screen resolution M1 from the display device 100 that is the connection destination, the smartphone 1 can generate screen data M2 that corresponds to the resolution of the display device 100 that is the connection destination.

[Configuration of Display Device 100]
Next, the configuration of the display device 100 will be described in detail with reference to FIG. The display device 100 is preferably a television receiver, a PC monitor, or the like, but is not limited to these devices, and any display device having a function of communicating with the smartphone 1 can be widely used.

  As illustrated, the display device 100 includes a control unit 110, a storage unit 111, a display unit 112, and an operation unit 113. Furthermore, although not shown, the display device 100 may include an audio output unit, a broadcast image receiving unit, and the like. Further, data transmission / reception with the smartphone 1 is performed via a communication unit (not shown) built in the display device 100.

  The storage unit 111 includes a nonvolatile storage device, and stores the screen resolution M1 (and the display direction 130). The storage unit 111 may further include a volatile storage area. This area is used as a work area for temporarily storing data used for calculation, calculation results, and the like in the course of various processes executed by the control unit 110.

  The display unit 112 includes a flat display panel such as a liquid crystal panel or an organic EL (Electroluminescence) panel, and displays information, images, and the like processed by the display device 100 on a display screen. The display unit 112 may also be configured to serve as the operation unit 113 as a touch panel.

  Usually, the shape of the display screen of the display unit 112 is a rectangle. Therefore, the direction of the display screen is either horizontal (horizontal) or vertical (vertically). The direction of the display screen is stored in the storage unit 111 as the display direction 130.

  Furthermore, the display part 112 may be formed so that it can rotate clockwise and / or counterclockwise. If the display unit 112 is formed in this way, the user can turn the display screen of the display device 100 horizontally or vertically. The current display screen direction is reflected in the display direction 130 stored in the storage unit 111.

  The operation unit 113 is an interface installed for a user to perform an input operation on the display device 100, and is, for example, a button, a keyboard, a touch panel, a remote controller, or the like. In the case of a remote controller, the operation unit 113 exists outside the display device 100.

  The control unit 110 controls the display device 100 as a whole. The control unit 110 includes a screen resolution transmission unit 120, a screen data acquisition unit 121, and an operation reception unit 122 as functional blocks.

  The screen resolution transmission unit 120 transmits the screen resolution M1 read from the storage unit 111 to the smartphone 1.

  The screen data acquisition unit 121 acquires screen data M2 from the smartphone 1 and causes the display unit 112 to display the screen data M2. Furthermore, when the control UI 41 is included in the screen data M2, the screen data acquisition unit 121 acquires the control information M3 transmitted from the smartphone 1. This control information M3 is used by the operation receiving unit 122 described later. The screen data acquisition unit 121 has a function of acquiring audio data from the smartphone 1 in addition to the screen data M2, and outputting the audio data via an audio output unit (not shown) included in the display device 100. It may be.

  The operation reception unit 122 receives a user operation through the operation unit 113, generates an operation signal M4 based on the user operation and the control information M3, and transmits the operation signal M4 to the smartphone 1. The operation signal M4 is a signal including a playback control command for controlling the playback operation of the content video 51. For example, when the operation unit 113 is a touch panel, the operation reception unit 122 acquires coordinates on the display screen indicating a position where the user has made a touch operation. And the reproduction | regeneration control command corresponding to the coordinate range in which this coordinate is included is acquired from the control information M3, is included in the control information M3, and is transmitted to the smart phone 1.

[Process flow]
FIG. 5 is a sequence diagram illustrating an example of a flow of processing executed in the screen transmission system 1000.

  First, the user connects the display device 100 and the smartphone 1 (S1). When the connection is established, the screen resolution transmission unit 120 of the display device 100 reads the screen resolution M1 from the storage unit 111 and transmits it to the smartphone 1 (S2). The screen resolution acquisition unit 20 of the smartphone 1 receives the transmitted screen resolution M1 (S3, acquisition step). Note that the timing at which the screen resolution transmission unit 120 transmits the screen resolution M1 may be a timing at which the direction of the content video 51 or the direction of the display screen is changed.

  Next, the screen data generation unit 21 of the smartphone 1 prepares blank screen data M2 having the same resolution as the received screen resolution M1 (S4).

  Subsequently, the content reproduction unit 22 reproduces the content video 51 (S5). Note that the timing at which the playback of the content video 51 is started is not limited to this timing, and the content video 51 may be played before the connection with the display device 100 is established.

  Subsequently, the direction determination unit 30 determines whether or not the direction of the content video 51 (content direction) matches the direction of the display screen (display direction 130) (S6).

  If the content direction matches the display direction 130 (YES in S6), the direction determination unit 30 further determines whether the content resolution 50 matches the screen resolution M1 (S7). When the content resolution 50 and the screen resolution M1 match (YES in S7), the screen data generation unit 21 pastes the content video 51 on the blank screen data M2 (S8, first synthesis process, first content addition) Step). Then, the screen data M2 is transmitted to the display device 100 (S14).

  On the other hand, when the content resolution 50 and the screen resolution M1 are different (NO in S7), the scaling processing unit 31 scales the content video 51 according to the resolution of the blank screen data M2 (screen resolution M1) (S9). Then, the scaled content video 51 is pasted on the screen data M2 (S10, first combining process, first content adding step), and the screen data M2 is transmitted to the display device 100 (S14).

  If the content direction and the display direction 130 are different (NO in S6), the scaling processing unit 31 scales the content video 51 according to the resolution of the blank screen data M2 (screen resolution M1) (S11). Then, the screen data generation unit 21 pastes the scaled content video 51 on the screen data M2 (S12, first synthesis process, first content addition step). Further, the screen data generation unit 21 pastes the control UI 41 read from the storage unit 11 in a blank area other than the content video 51 in the screen data M2 (S13, second synthesis process, second content addition step). The screen data generation unit 21 transmits the screen data M2 generated in this way and the control information M3 of the control UI 41 to the display device 100 (S14).

  After the screen data M2 is transmitted in S14, the process of the smartphone 1 returns to S5. However, in the second and subsequent processes, the processes in steps S6 and S7 may be omitted and the previous determination result may be used. Then, the screen data generation unit 21 performs the first synthesis process and the second synthesis process on the previous screen data M2 instead of the blank screen data M2.

  The screen data acquisition unit 121 of the display device 100 receives the screen data M2 transmitted from the smartphone 1 (S15). When the control information M3 is transmitted from the smartphone 1 (that is, when the control UI 41 is added to the screen data M2), the control information M3 is also acquired. Then, the screen data acquisition unit 121 displays the acquired screen data M2 on the display screen of the display unit 112 (S16). The screen data acquisition unit 121 continues to update the display screen by displaying the received screen data M2 every time the screen data M2 is received from the smartphone 1.

  Then, when the control UI 41 is included in the screen data M2, the processes of the following steps (S17 to S20) are executed.

  When there is a user operation on the control UI 41 (YES in S17), the operation reception unit 122 acquires a reproduction control command corresponding to the user operation based on the control information M3. Then, the reproduction control command is included in the operation signal M4 and transmitted to the smartphone 1 (S18).

  The operation signal acquisition unit 23 of the smartphone 1 receives the operation signal M4 (S19). Then, an instruction is sent to the content playback unit 22 based on the playback control command included in the received operation signal M4. Receiving this instruction, the content playback unit 22 changes the playback operation of the content video 51 (S20). Thereafter, the process of the smartphone 1 returns to S5.

[Embodiment 2]
Hereinafter, another embodiment of the present invention will be described in detail with reference to FIG.

  FIG. 6 is a diagram illustrating screen data M2 generated by the smartphone 1 according to the present embodiment. As illustrated, in the present embodiment, the screen data generation unit 21 pastes a display image 300 of a display unit (not shown) included in the smartphone 1 instead of pasting the control UI 41 to the screen data M2. Therefore, the screen of the smartphone 1 is mirrored and displayed on the display screen of the display device 100.

  According to the present embodiment, the smartphone 1 causes the display device 100 to display the content video 51 being played on the own device, and causes the display device 100 to display the display screen of the own device side by side with the content video 51. it can. Thus, the content to be pasted in the margin area of the content video 51 in the screen data M2 is not limited to the control UI 41.

  Furthermore, the operation reception unit 122 generates an operation signal M4 for operating the screen indicated by the display image 300 of the smartphone 1 based on a user operation (for example, a touch operation) on the display device 100, and transmits the operation signal M4 to the smartphone 1. May be. Thereby, the screen of the smart phone 1 can be operated on the display device 100 side. That is, the function of the operation unit of the smartphone 1 can be substituted for the display device 100.

[Embodiment 3: Implementation by software]
The control blocks (the control unit 10 and the control unit 110) of the smartphone 1 and the display device 100 may be realized by a logic circuit (hardware) formed in an integrated circuit (IC chip) or the like, or may be software using a CPU. It may be realized by.

  In the latter case, the smartphone 1 and the display device 100 include a CPU that executes instructions of a program that is software that realizes each function, and a ROM (Read Only) in which the program and various data are recorded so as to be readable by a computer (or CPU) Memory) or a storage device (these are referred to as “recording media”), a RAM (Random Access Memory) for expanding the program, and the like. And the objective of this invention is achieved when a computer (or CPU) reads the said program from the said recording medium and runs it. As the recording medium, a “non-temporary tangible medium” such as a tape, a disk, a card, a semiconductor memory, a programmable logic circuit, or the like can be used. The program may be supplied to the computer via an arbitrary transmission medium (such as a communication network or a broadcast wave) that can transmit the program. The present invention can also be realized in the form of a data signal embedded in a carrier wave in which the program is embodied by electronic transmission.

[Summary]
The display control device (smart phone 1) according to aspect 1 of the present invention generates a display image (screen data M2) having a resolution equal to the screen resolution (M1) of the display screen included in the display device (100), and performs the display A display control device that transmits an image to the display device and displays the image on the display screen included in the display device, and an acquisition unit that acquires the screen resolution of the display screen included in the display device (screen resolution acquisition unit 20 ), First content adding means (screen data generating unit 21) for including the first content (content video 51) in the display image, and the screen resolution acquired by the acquiring means in the display image. Second content adding means (screen data generating unit 21) including the second content (control UI 41) in an area other than the first content Equipped with a.

  A control method for a display control device according to aspect 8 of the present invention generates a display image having a resolution equal to the screen resolution of a display screen included in the display device, transmits the display image to the display device, and transmits the display image to the display device. A display control apparatus for displaying on the display screen, the acquisition step (S3) for acquiring the screen resolution of the display screen included in the display apparatus, and including the first content in the display image Based on the first content adding step (S8, S10, S12, first combining process) and the screen resolution acquired in the acquiring step, the second content is added to an area other than the first content in the display image. Including a second content adding step (S13, second combining process).

  According to said structure and method, the said display control apparatus acquires the screen resolution of the display screen with which a display apparatus is provided. In addition, the first content is included in the display image, and the second content is included in an area other than the first content in the display image based on the acquired screen resolution. Then, the generated display image is transmitted to the display device and displayed on the display screen included in the display device.

  Therefore, the display control device includes the second content in a region other than the first content (hereinafter referred to as a blank region) in the display image, and transmits the display image to the display device. For this reason, the display control apparatus can display the display image in a state where the blank area other than the first content is reduced on the display apparatus. Therefore, the display screen of the display device can be effectively used.

  Also, conventionally, when content is transmitted and displayed on a display device, if the screen resolution of the display device does not match the content resolution (or aspect ratio, angle of view information, etc.), part of the content is missing. May be displayed in the status. In addition, even if simple scaling processing is performed on the display device side, the displayed content may be crushed or a black area (frame) in which nothing is displayed may be generated, resulting in a loss of design. There is.

  Such a problem occurs because the device on the content transmission side generates an appropriate display image corresponding to the screen resolution of the display device and does not transmit the display image.

  Therefore, the display control device acquires the screen resolution of the display screen included in the display device, and generates a display image based on the acquired screen resolution. Thereby, the display control device can generate a display image suitable for the screen resolution of the display screen included in the display device, and display the display device on the display device having an arbitrary resolution. For example, even if the screen resolution of the display device and the resolution of the content do not match, a display image in which the content held by the own device is appropriately arranged is generated and displayed according to the acquired screen resolution. It can be displayed on the device.

  Therefore, the conventional problems such as a part of the content being lost, the content being crushed, and the black area being enlarged can be solved, so that the display quality can be improved.

  In the display control device according to aspect 2 of the present invention, in the aspect 1, the second content adding unit is configured such that the long side direction (content direction) of the first content on the display screen is the long side direction of the display screen ( The second content may be included in a region other than the first content in the display image only when different from the display direction 130).

  According to the above configuration, the display control device includes the second content in the region other than the first content only when the long side direction of the display screen of the display device is different from the long side direction of the first content. . Usually, when the long-side directions of the two coincide (especially when the aspect ratio is close), the blank area other than the first content on the display screen becomes smaller than when they are different.

  Therefore, the display control apparatus includes the second content in the blank area only when the long side direction is different. Therefore, since the second content is not included when the long side directions match, it is possible to avoid a situation in which the second content is too small to be visually recognized or a part of the second content is missing. Moreover, since the process including the second content can be omitted, the display image can be generated in a short time.

  The display control apparatus according to aspect 3 of the present invention is the display control apparatus according to aspect 1 or 2, wherein the second content adding unit is configured only when a region other than the first content in the display image exceeds a predetermined size. The second content may be included in a region other than the first content in the display image.

  According to the above configuration, the display control device includes the second content in the region other than the first content only when the region other than the first content exceeds a predetermined size.

  That is, the display control device does not include the second content in the blank area when the blank area is equal to or smaller than a predetermined size. Accordingly, it is possible to avoid a situation in which the second content is too small to be visually recognized or a part of the second content is missing. Moreover, since the process including the second content can be omitted, the display image can be generated in a short time.

  In the display control device according to aspect 4 of the present invention, in any one of the aspects 1 to 3, the second content is display information (control UI 41, indicator) related to reproduction of the first content. There may be.

  According to said structure, 2nd content is the information for a display relevant to reproduction | regeneration of 1st content. Therefore, the display control apparatus can fill the blank area with information related to the reproduction of the first content. In particular, since information related to reproduction of the first content is likely to be information that is of interest to the user viewing the first content, it is more useful than the black area (frame) that has been displayed conventionally. There is an effect that information can be provided to the user.

  In the display control device according to aspect 5 of the present invention, in the aspect 4, the second content is display information (control UI 41) for the user to instruct reproduction control of the first content, and the first content is The apparatus may further include reproduction control means (content reproduction unit 22, operation signal acquisition unit 23) that acquires an instruction from the user for content reproduction control and controls reproduction of the first content based on the instruction.

  According to said structure, the said display control apparatus acquires the instruction | indication by the user of the reproduction | regeneration control of 1st content, and controls reproduction | regeneration of 1st content based on the said instruction | indication. Therefore, the display control device can fill the blank area using the second content, obtain an instruction from the user based on the second content, and can control the reproduction of the first content.

  The display control device according to aspect 6 of the present invention is the display control device according to any one of the aspects 1 to 5, wherein the first content adding unit includes at least one resolution in the long side direction and the short side direction of the first content. However, the first content scaled in the long side direction and the short side direction may be included in the display image until the resolution of at least one of the long side direction and the short side direction of the display screen is reached.

  According to the above configuration, the display control device performs scaling processing on the first content, thereby expanding the first content to the full width or height of the display device, and then setting the blank area as the second content. Can be filled with. Therefore, the display control device can display the first content on the display device as large as possible in accordance with the screen resolution of the display device.

  The display control device according to aspect 7 of the present invention is the display control device according to any one of aspects 1 to 6, further comprising a display unit, wherein the second content adding unit is an image displayed on the display unit. A device display image (display image 300) may be included in the display image as the second content.

  According to said structure, the said display control apparatus can display the display screen displayed on the display part with which an own apparatus is provided in a blank area | region.

  The display control device and the display device may be realized by a computer. In this case, the display control device and the display device are operated by causing the computer to operate as each unit included in the display control device and the display device. The display control device for realizing the display device by a computer, the control program for the display device, and a computer-readable recording medium on which the control program is recorded also fall within the scope of the present invention.

  The present invention is not limited to the above-described embodiments, and various modifications are possible within the scope shown in the claims, and embodiments obtained by appropriately combining technical means disclosed in different embodiments. Is also included in the technical scope of the present invention. Furthermore, a new technical feature can be formed by combining the technical means disclosed in each embodiment.

  The display control apparatus according to the present invention can be applied to an information processing apparatus having a function of transmitting display content. In particular, the present invention can be widely applied to various information processing apparatuses such as smartphones, mobile phones, personal computers, tablet PCs, cameras, DVD players, BD players, and cable television STBs.

1 Smartphone (display control device)
20 Screen resolution acquisition unit (acquisition means)
21 Screen data generation unit (first content adding means, second content adding means)
22 Content playback unit (playback control means)
23 Operation signal acquisition unit (reproduction control means)
30 Direction determination unit 31 Scaling processing unit 41 Control UI (second content)
50 Content resolution 51 Content video (first content)
100 Display device 112 Display unit 130 Display direction (long side direction of display screen)
300 Display image (second content, own device display image)
M1 screen resolution M2 screen data (display image)

Claims (10)

A display control device that generates a display image having a resolution equal to the screen resolution of a display screen included in the display device, transmits the display image to the display device, and causes the display device to display the display image.
Obtaining means for obtaining the screen resolution of the display screen included in the display device;
First content adding means for including the first content in the display image;
A display control apparatus comprising: a second content adding unit that includes a second content in an area other than the first content in the display image based on the screen resolution acquired by the acquiring unit.   The second content adding means adds the first content to the region other than the first content in the display image only when the long side direction of the first content on the display screen is different from the long side direction of the display screen. The display control apparatus according to claim 1, comprising two contents.   The second content adding means adds the second content to a region other than the first content in the display image only when a region other than the first content in the display image exceeds a predetermined size. The display control device according to claim 1, wherein the display control device is included.   The display control apparatus according to claim 1, wherein the second content is display information related to reproduction of the first content. The second content is display information for a user to instruct playback control of the first content,
5. The display according to claim 4, further comprising reproduction control means for acquiring an instruction from a user for reproduction control of the first content and controlling reproduction of the first content based on the instruction. Control device.   The first content adding means is arranged in the long side direction until the resolution of at least one of the long side direction and the short side direction of the first content reaches at least one resolution of the long side direction and the short side direction of the display screen. The display control apparatus according to claim 1, wherein the display content includes the first content scaled in the short side direction at an equal magnification. A display unit;
The said 2nd content addition means includes the self-device display image which is an image displayed on the said display part in the said image for a display as said 2nd content in any one of Claim 1 to 6 characterized by the above-mentioned. The display control apparatus described. A display control device control method for generating a display image having a resolution equal to a screen resolution of a display screen included in a display device, transmitting the display image to the display device, and displaying the display image on the display screen included in the display device. There,
An acquisition step of acquiring the screen resolution of the display screen included in the display device;
A first content adding step of including the first content in the display image;
A second content adding step of including a second content in a region other than the first content in the display image based on the screen resolution acquired in the acquiring step. Control method.   A program for causing a computer to function as the display control device according to claim 1, wherein the program causes the computer to function as each of the means.   A computer-readable recording medium on which the program according to claim 9 is recorded.

Images