WO2015056622A1 - Dispositif d'affichage d'image, procédé d'affichage d'image, récepteur de télévision, programme et support d'enregistrement - Google Patents

Dispositif d'affichage d'image, procédé d'affichage d'image, récepteur de télévision, programme et support d'enregistrement Download PDF

Info

Publication number
WO2015056622A1
WO2015056622A1 PCT/JP2014/077041 JP2014077041W WO2015056622A1 WO 2015056622 A1 WO2015056622 A1 WO 2015056622A1 JP 2014077041 W JP2014077041 W JP 2014077041W WO 2015056622 A1 WO2015056622 A1 WO 2015056622A1
Authority
WO
WIPO (PCT)
Prior art keywords
image
mosaic
unit
superimposed
partial
Prior art date
Application number
PCT/JP2014/077041
Other languages
English (en)
Japanese (ja)
Inventor
藤本　欣也
Original Assignee
シャープ株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by シャープ株式会社 filed Critical シャープ株式会社
Publication of WO2015056622A1 publication Critical patent/WO2015056622A1/fr

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/478—Supplemental services, e.g. displaying phone caller identification, shopping application
    • H04N21/4781—Games
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00—Geometric image transformations in the plane of the image
    • G06T3/40—Scaling of whole images or parts thereof, e.g. expanding or contracting
    • G06T3/4038—Image mosaicing, e.g. composing plane images from plane sub-images
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/45—Management operations performed by the client for facilitating the reception of or the interaction with the content or administrating data related to the end-user or to the client device itself, e.g. learning user preferences for recommending movies, resolving scheduling conflicts
    • H04N21/462—Content or additional data management, e.g. creating a master electronic program guide from data received from the Internet and a Head-end, controlling the complexity of a video stream by scaling the resolution or bit-rate based on the client capabilities
    • H04N21/4622—Retrieving content or additional data from different sources, e.g. from a broadcast channel and the Internet
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2340/00—Aspects of display data processing
    • G09G2340/04—Changes in size, position or resolution of an image
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2340/00—Aspects of display data processing
    • G09G2340/12—Overlay of images, i.e. displayed pixel being the result of switching between the corresponding input pixels
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2340/00—Aspects of display data processing
    • G09G2340/14—Solving problems related to the presentation of information to be displayed
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
    • G09G5/08—Cursor circuits
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
    • G09G5/10—Intensity circuits

Definitions

  • the present invention relates to an image display device and a display method of the image display device.
  • the present invention also relates to a television receiver provided with each means of the image display device, a program for operating a computer as the image display device, and a recording medium on which such a program is recorded.
  • TVs Television receivers equipped with liquid crystal panels are becoming widely used.
  • the performance of televisions has improved, and the functions of televisions have also diversified.
  • Patent Document 1 discloses a television having a function of performing a puzzle game in which a still image (a frozen frame of a video stream, that is, a frame image constituting a television program) is puzzled. Thereby, the user can enjoy a mini game between watching TV programs.
  • a still image a frozen frame of a video stream, that is, a frame image constituting a television program
  • Patent Document 1 when the technique described in Patent Document 1 is applied to a television receiver to display a television program as a puzzle, the following problems occur. That is, when a screen in which a character superimposition such as an earthquake early warning is superimposed on a television program is made into a puzzle, the character super is also made into a puzzle, which makes it difficult to recognize the contents of the character super. Such a problem is not limited to the case where the screen on which the character superimposition is superimposed is made into a puzzle, but may occur when the screen on which any object that needs to be visually recognized by the user is made into a puzzle.
  • FIG. 20 is a diagram showing an example of a puzzle game screen displayed on an image display device in the prior art.
  • 20A shows an example of an image and an object before puzzle formation
  • FIG. 20B shows an example of a screen on which an object is superimposed on an image before puzzle formation
  • FIG. 20C shows an example of a puzzle game screen. Yes.
  • the present invention has been made to solve the above-described problems, and its main purpose is to prevent a decrease in the visibility of an object displayed together with an image even when the image is mosaicked.
  • An object is to provide an image display device.
  • an image display device divides an image into a plurality of partial images and generates a mosaic image by exchanging the partial images.
  • An image display device includes an object area detection unit that detects an object area including the character information from a composite image including an image and character information in order to solve the above-described problem. Dividing an image included in an area other than the object area of the composite image into a plurality of partial images, generating a mosaic image by exchanging the partial images, and converting the character information into the mosaic image Display means for displaying in a different area from the display area.
  • An image display method is an image display method of an image display device in order to solve the above-described problem.
  • the image display method divides an image into a plurality of partial images and mosaics by replacing the partial images.
  • a display step for generating a digitized image, and a display step for displaying a superimposed image in which at least part of character information received from the outside is superimposed on the mosaiced image, wherein the character information is displayed without being mosaicked.
  • an image display method is an image display method for an image display device, in which the character information is included from a composite image including an image and character information.
  • An object area detecting step for detecting an object area, and mosaicing that divides an image included in an area other than the object area of the composite image into a plurality of partial images and generates a mosaic image by replacing the partial images.
  • the image display device can prevent the visibility of the object displayed together with the image from being lowered even when the image is mosaicked.
  • FIG. 1 It is a figure which shows typically the flow of the mosaic image generation process which concerns on one modification of one Embodiment of this invention, (a) shows an example of the frame image before performing a superposition mosaic image generation process (B) shows an example of a cursor and arrow that have been demosaiced, and (c) shows an example of a superimposed mosaiced image that has undergone a superimposed mosaiced image generation process. It is a graph which shows the blinking period of the cursor and arrow currently displayed on the puzzle game which concerns on the modification of one Embodiment of this invention, (a) shows an example of the blinking period of a cursor, (b) is An example of the blinking cycle of an arrow is shown.
  • FIG. 1 It is a figure which shows an example of the puzzle game which concerns on the other modification of one Embodiment of this invention, (a) shows an example of a puzzle game typically, (b) and (c) are blinking of a cursor. An example of the period is shown. It is a figure which shows typically the flow of the mosaic image generation process which concerns on the other modification of one Embodiment of this invention, (a) is an example of the frame image before performing a superposition mosaic image generation process (B) shows an example of a cursor and arrow that have been demosaiced, and (c) shows an example of a superimposed mosaiced image that has undergone a superimposed mosaiced image generation process.
  • FIG. 1 It is a block diagram which shows the principal part structure of the television which concerns on further another embodiment of this invention. It is a figure which shows typically the division
  • the image display device is realized by a television receiver (television), hereinafter, it is also referred to as a television.
  • the image display device according to the present invention is not limited to a television, and may be realized by an image display control device that does not have a display unit such as a DVD player or an HD player.
  • FIG. 2 is an external view showing the external appearance of the television 10 and the remote controller 20 according to the present embodiment.
  • FIG. 1 is a block diagram illustrating a main configuration of the television 10 according to the present embodiment.
  • the television 10 includes a tuner unit 101, a decoder 102, a video buffer 103, a scaling unit 104, a transfer unit 105, a graphic buffer 106, a mosaic processing unit 120, and a remote control receiving unit, as shown in FIG. 108, a display control unit (display unit) 109, and a display 110.
  • the tuner unit 101 is a tuner for receiving a broadcast program broadcast by terrestrial digital broadcast, a broadcast program broadcast by satellite broadcast, and the like.
  • the tuner unit 101 also receives data broadcasts such as superimpose characters and subtitles that are displayed in a superimposed manner with broadcast programs such as earthquake early warnings (so-called superimpose).
  • the tuner unit 101 may be a double tuner that can simultaneously receive two broadcast programs broadcast via different channels, or a multi-tuner that can simultaneously receive three or more broadcast programs. It may be.
  • the decoder 102 decodes moving image data representing a broadcast program received by the tuner unit 101 into a video signal and an audio signal.
  • the decoder 102 is, for example, an RF unit that converts a received signal indicating a broadcast program received by the tuner unit 101 into an analog baseband signal, an ADC unit that converts an analog baseband signal into a digital baseband signal, and MPEG2 from the digital baseband signal.
  • the demodulator can demodulate the stream, and the decoder can decode the video signal and the audio signal from the MPEG2 stream.
  • the decoder 102 sequentially stores the frame images (frame images) constituting the decoded video signal in the video buffer 103. Further, the decoder 102 sequentially stores objects such as character information indicated by the data broadcast received by the tuner unit 101 in the object buffer 107.
  • Video buffer Frame images are sequentially stored in the video buffer 103 by the decoder 102.
  • the frame images are sequentially stored in the video buffer 103 at the same cycle (hereinafter, also simply referred to as 1V cycle) as one vertical synchronization frequency (1V frequency).
  • the scaling unit 104 sequentially acquires frame images stored in the video buffer 103 and generates a video plane (first display layer). In addition, the scaling unit 104 performs scaling processing on the frame image included in the generated video plane, and then supplies it to the display control unit 109. Note that the scaling unit 104 sequentially acquires the frame images from the video buffer 103 at the same cycle (1V cycle) as the cycle at which the frame images are stored in the video buffer 103.
  • the scaling unit 104 may scale the size of the frame image to the size displayed on the entire display 110 or the size displayed on a partial area of the display 110.
  • the size of scaling in the scaling unit 104 may be determined, for example, by a user instruction received via the remote controller 20, or may be controlled by a control unit (not shown).
  • the scaling unit 104 sequentially supplies the generated video plane to the display control unit 109.
  • the transfer unit 105 sequentially acquires the frame images stored in the video buffer 103 and sequentially stores the acquired frame images in the graphic buffer 106.
  • the transfer unit 105 sequentially stores frame images in the graphic buffer 106 at the same cycle (1V cycle) as the cycle in which the frame images (second frame images) are stored in the video buffer 103 is described.
  • the present invention is not limited to this.
  • the transfer unit 105 may sequentially store the frame images in the graphic buffer 106 at a cycle of an integer multiple of 1V cycle (2V cycle, 3V cycle, etc.).
  • Object buffer In the object buffer 107, character information received from the outside (more specifically, character information decoded from the data broadcast by the decoder 102) (for example, subtitles, character supermarkets, etc.) is sequentially stored.
  • UI user interface
  • UI elements to be displayed on a partial image selected from a plurality of partial images to be described later, and UI elements for assisting the user's operation on the display screen are sequentially provided.
  • Examples of the UI element include a cursor that focuses a selection target, and an arrow that indicates an operation direction.
  • the “object” is a general term for information displayed together with an image, such as the character information and UI elements described above.
  • the mosaic processing unit 120 sequentially acquires the frame image stored in the graphic buffer 106 and the object stored in the object buffer 107, and generates a graphic plane. Further, as described later, the mosaic processing unit 120 is selected (designated) by a user instruction related to display of a mosaic image such as a puzzle game indicated by the remote control signal received by the remote control reception unit 108. A superimposed mosaic image generation process for generating a converted image is executed.
  • the remote control receiving unit 108 receives a remote control signal that is wirelessly transmitted from the remote control 20 and indicates a user instruction performed by the user operating the remote control 20, and the received remote control signal is received according to the user instruction indicated by the remote control signal. It supplies to each part with which the television 10 is provided.
  • the remote control receiving unit 108 supplies the remote control signal to the mosaic processing unit 120.
  • the remote control reception unit 108 supplies the remote control signal to the scaling unit 104 and the mosaic processing unit 120.
  • the remote controller 20 receives a user's remote control operation and transmits a user instruction indicated by the received remote control operation as a remote control signal to the television 10 (more specifically, the remote control reception unit 108 provided in the television 10).
  • the remote controller 20 according to the present embodiment can also be realized by a remote control function such as a smartphone.
  • wireless communication between the remote controller 20 and the remote control receiver 108 examples include wireless communication such as infrared, Bluetooth (registered trademark), and IEEE 80211, for example, but are not limited thereto. .
  • the display control unit 109 displays a superimposed mosaic image (superimposed image) in which an object is superimposed at a specific position on the mosaic image on the display 110.
  • the display control unit 109 displays the broadcast program including the frame images included in the video plane on the display 110 by sequentially drawing the video plane sequentially supplied from the scaling unit 104 on the display 110. Further, the display control unit 109 displays on the display 110 a puzzle-like broadcast program made up of frame images included in the graphic plane by sequentially drawing the graphic plane sequentially supplied from the mosaic processing unit 120 on the display 110. .
  • the display control unit 109 synchronously superimposes the video plane sequentially supplied from the scaling unit 104 and the graphic plane sequentially supplied from the mosaic processing unit 120, and draws them on the display 110. More specifically, the display control unit 109 draws the graphic plane on the display 110 by superimposing the graphic plane on the video plane. A method for synchronizing the video plane and the graphic plane will be described later.
  • a method for superimposing a graphic plane on a video plane includes, for example, alpha blending, but is not particularly limited.
  • the superimposed mosaic image composed of the frame image and the object included in the graphic plane is OSD displayed superimposed on the video plane.
  • FIG. 3 is a block diagram illustrating a main configuration of the mosaic processing unit 120 included in the television 10 according to the present embodiment.
  • the mosaic processing unit 120 includes a de-mosaic unit (de-mosaic unit, display mode control unit) 121, a superimposition unit (mosaic unit) 122, and a mosaic unit (mosaic unit). 123.
  • the mosaic processing unit 120 reads out an arrangement reference frame associated with the mosaic image designated in the user instruction indicated by the remote control signal from a storage unit (not shown). Then, the mosaic processing unit 120 supplies the read arrangement reference frame to the inverse mosaicing unit 121 and the mosaicing unit 123 included in the mosaic processing unit 120.
  • the arrangement reference frame according to the present embodiment, a plurality of blocks are arranged in a lattice pattern.
  • the mosaic processing unit 120 when reading the arrangement reference frame, the mosaic processing unit 120 generates an arrangement table for determining which of the partial images (to be described later) to be arranged for which block of the arrangement reference frame. .
  • the mosaic processing unit 120 displays, in the display control unit 109, the graphic plane in which the frame images subjected to the mosaic image generation processing in each unit of the mosaic processing unit 120 are arranged in the blocks included in the arrangement reference frame. Supply sequentially.
  • the inverse mosaicing unit 121 divides the object into a plurality of partial objects, and executes a reverse mosaicing process that generates inverse mosaiced objects by exchanging the partial objects. Further, the inverse mosaicing unit 121 replaces the partial objects so that the objects are arranged at specific positions on the mosaic image in the mosaic image generated by the mosaicing unit 123.
  • the specific position refers to the same position as the position on the frame image on which the object before the inverse mosaic processing is displayed.
  • the de-mosaic unit 121 first sequentially reads out the objects stored in the object buffer 107, and converts the read objects into a plurality of partial objects according to the arrangement reference frame. To divide. Then, the de-mosaic unit 121 refers to the arrangement table, and when the mosaic image is generated in the mosaic unit 123, the object that has returned to the state before the de-mosaic process is performed is described above. The arrangement of the partial objects is exchanged so as to be arranged at a specific position, and an inverse mosaiced object is generated.
  • the superimposing unit 122 divides the frame image into a plurality of partial images.
  • the superimposing unit 122 superimposes the mosaic object on the frame image divided into the partial images.
  • the superimposing unit 122 first reads the frame image stored in the graphic buffer 106 and divides the read frame image into a plurality of partial images according to the arrangement reference frame. Then, the partial objects constituting the inverse mosaic object are superimposed on each of the divided partial images.
  • the mosaic unit 123 is means for generating a mosaic image by exchanging partial images (mosaicing). That is, the mosaic unit 123 functions as a mosaic unit together with the superimposing unit 122 and executes the mosaic process.
  • the mosaicing unit 123 obtains an image (also referred to as a superimposed frame image) obtained by superimposing an inverse mosaic object on a frame image from the superposition unit 122, and obtains the superimposed frame image obtained by referring to the arrangement table. A superimposed mosaic image is generated.
  • the mosaic processing unit 120 uses the inverse mosaicing unit 121, the superimposing unit 122, and the mosaicing unit 123 to superimpose a mosaiced image in which an object is superimposed at a specific position on a mosaiced image. Is generated.
  • the superimposing unit 122 of the mosaic processing unit 120 may sequentially acquire the frame image in 1V cycle when the transfer unit 105 sequentially stores the frame image in the graphic buffer 106 in 1V cycle. You may acquire sequentially with the period of the integral multiple of 1V period.
  • the inverse mosaicing unit 121 may also sequentially acquire objects from the object buffer 107 at a cycle of 1V or an integer multiple of 1V.
  • the superimposing unit 122 may acquire the image sequentially in a cycle that is an integral multiple of 1V cycle.
  • the inverse mosaicing unit 121 may also sequentially acquire objects from the object buffer 107 at a cycle that is an integral multiple of 1V cycle.
  • each unit of the mosaic processing unit 120 When the mosaic image is, for example, a puzzle game, each unit of the mosaic processing unit 120 generates the puzzle game by sequentially acquiring the frame image and the object in 1V cycle, thereby realizing the puzzle game with a smooth moving image. be able to. On the other hand, each part of the mosaic processing unit 120 sequentially acquires frame images and objects at a cycle that is an integer multiple of the 1V cycle to generate a puzzle game, thereby generating a puzzle game on the television 10 including the mosaic processing unit 120. It is possible to reduce the processing load related to generation.
  • FIG. 4 is a flowchart showing a flow of the superimposed mosaic image generation process in the mosaic processing unit 120 included in the television 10 according to the present embodiment.
  • FIG. 5 is a diagram schematically showing the flow of the superimposed mosaic image generation process according to this embodiment.
  • FIG. 5A shows an example of a frame image and a character super before the superimposed mosaic image generation processing is performed
  • FIG. 5B shows an example of a character super image that has been demosaiced
  • FIG. 5C shows an inverse mosaic.
  • An example of the superimposed frame image on which the converted character superimposition is superimposed is shown
  • (d) shows an example of the superimposed mosaic image that has been subjected to the superimposed mosaic image generation process.
  • the mosaic processing unit 120 When the mosaic processing unit 120 receives a remote control signal indicating a user instruction to display the puzzle game (also simply referred to as a puzzle display instruction), the mosaic processing unit 120 starts the mosaic image generation process shown in FIG.
  • the mosaic processing unit 120 acquires the puzzle display instruction
  • the data is read from a storage unit (not shown) (step S101).
  • a storage unit not shown
  • the mosaic processing unit 120 When the mosaic processing unit 120 reads out the puzzle frame, the mosaic processing unit 120 generates an arrangement table for determining which of the partial images is arranged in which block of the puzzle frame (step S102).
  • the mosaic processing unit 120 may determine the arrangement table at random each time, or may determine according to the designated difficulty level when the difficulty level of the puzzle game is designated in the puzzle display instruction. . Details of the arrangement table will be described later with different drawings.
  • the de-mosaicing unit 121 included in the mosaicing processing unit 120 reads the character superposition stored in the object buffer 107 and divides it into a plurality of partial objects so that they can be arranged in blocks of the puzzle frame (Ste S103). For example, when the puzzle frame has 16 blocks of 4 rows and 4 columns, the inverse mosaicing unit 121 converts the character supers of 4 rows and 4 columns as shown in FIG. Divide into partial objects consisting of 16 blocks.
  • the de-mosaic unit 121 refers to the arrangement table and arranges the partial objects in the corresponding blocks of the puzzle frame as shown in FIG. 5B (de-mosaic processing).
  • the generated inverse mosaiced object is generated (step S104).
  • the superimposing unit 122 included in the mosaic processing unit 120 can acquire the frame image stored in the graphic buffer 106 and can arrange the acquired frame image in the block of the puzzle frame. In this manner, the image is divided into a plurality of partial images (step S105).
  • the superimposing unit 122 superimposes the inverse mosaic object on the frame image divided into the partial images (step S106).
  • the partial image on which the inverse mosaicked object is superimposed is, for example, as shown in FIG.
  • the mosaicing unit 123 refers to the arrangement table, arranges the partial image in a corresponding block of the puzzle frame (mosaicing process), and generates a superimposed mosaic image (Step S107).
  • the superimposed mosaic image is, for example, as shown in FIG.
  • the mosaic image generated in the mosaic unit 123 is an object that has returned to the state before being subjected to the de-mosaic process due to the mosaic process. Will be superimposed. That is, the mosaic image generated by the mosaic unit 123 is a superimposed mosaic image.
  • the de-mosaic unit 121 performs the de-mosaic process by performing the processes of steps S103 to S104. Further, the superimposing unit 122 and the mosaicing unit 123 execute the mosaicing process by executing the processes of steps S105 to S107.
  • the mosaic processing unit 120 sequentially acquires the frame images sequentially stored in the graphic buffer and repeatedly executes the processing from step S102 to step S107. Thereby, since the partial image arrange
  • FIG. 6 is a diagram illustrating an example of an arrangement table generated in the mosaic processing unit 120 according to the present embodiment.
  • the mosaic processing unit 120 attaches a partial image number having the same value as the block number given to the block at the position corresponding to the partial image to each partial image divided in accordance with the puzzle frame. .
  • the mosaic processing unit 120 replaces the partial image arranged in a certain block with the partial image arranged in another block, and is arranged in each block and each block as shown in FIG.
  • An arrangement table associated with the partial image to be generated is generated.
  • the partial image with the partial image number “0” is arranged in the block with the block number “0”, and the partial image with the partial image number “A” in the block with the block number “1”. Will be placed.
  • the mosaic processing unit 120 generates a graphic plane including the puzzle frame images in which the partial images are arranged in the corresponding blocks with reference to the arrangement table, and supplies the graphic plane to the display control unit 109.
  • the generated arrangement table may be stored in a storage unit (not shown).
  • the de-mosaicing unit 121 executes the de-mosaic process for generating the de-mosaic object with reference to the arrangement table in step S104 of the superimposed mosaic image generation process.
  • the inverse mosaicing unit 121 superimposes the object that has returned to the state before the inverse mosaicing process is performed by mosaicing the superimposed mosaiced image, as in the superimposed mosaiced image illustrated in FIG. A de-mosaic object is generated so as to obtain a processed image.
  • the inverse mosaicing unit 121 superimposes the partial object “1” illustrated in (a) on the partial image “A” in the mosaic processing by the mosaicing unit 123 as illustrated in (d) ( In other words, it is arranged in the block “A” as shown in (b) so as to be rearranged in the block “1”.
  • the de-mosaicing unit 121 arranges the partial objects “0”, “2” to “9” and “A” to “F” as follows in the de-mosaic process. -Place the partial object “0” on the block “0” to be superimposed on the partial image "0”-Place the partial object “2” on the block “D” to superimpose the partial object “2” on the partial image “D” In order to superimpose the object “3” on the partial image “2”, the arrangement / partial object “4” is placed on the block “5” in order to superimpose the arrangement / partial object “4” on the block “2”.
  • the arrangement / partial object“ 6 ”on the block“ B ” is superimposed on the partial image“ F ”.
  • the arrangement / partial object “8” is superimposed on the block “4”
  • the arrangement / partial object “9” is superimposed on the block “3”.
  • the arrangement / partial object “A” is superimposed on the block “6”
  • the arrangement / partial object “B” is superimposed on the block “1”.
  • the arrangement / partial object “C” is superimposed on the block “7”, and on the partial image “8”, the arrangement / partial object “D” is placed on the block “8” and the partial image “9”. ”Is placed on the block“ 9 ”, and the placement / partial object“ F ”is placed on the block“ C ”, and the placement / partial object“ F ”is placed on the partial image“ E ”.
  • the inverse mosaicing unit 121 generates an inverse mosaiced object as shown in FIG.
  • the mosaic unit 123 generates a mosaic process that generates a superimposed mosaic image with reference to the arrangement table. At this time, the mosaic unit 123 generates a superimposed mosaic image shown in FIG. 5D by mosaicing the frame image on which the mosaic object shown in FIG. 5C is superimposed.
  • the mosaic unit 123 converts the partial image “1” on which the partial object “A” illustrated in (c) is superimposed into a block “A” as illustrated in FIG. To place.
  • the mosaic unit 123 arranges the partial images “0”, “2” to “9”, and “A” to “F” as follows in the mosaic processing.
  • the partial image “0” on which the partial object “0” is superimposed is arranged on the block “0”.
  • the partial image “2” on which the partial object “3” is superimposed is arranged on the block “3”.
  • the television 10 when an object is superimposed after generating a mosaic image, more specifically, when an object read from the object buffer 107 is superimposed on a mosaic image in the display control unit 109, the overlay process in the display control unit 109 is performed. You may not be able to catch up. As a result, there may be a problem that the visibility is lowered due to the flickering of the object or the mosaic image or the loss of a part of the object or the mosaic image.
  • the television 10 according to the present embodiment can suppress the decrease in the visibility of the superimposed object while avoiding the problem that the visibility of the mosaic itself decreases.
  • a configuration in which a superimposed mosaic image is generated from a recorded program and a character superstore stored in an HDD built in the television 10 may be employed.
  • a superimposed mosaic image may be generated from content recorded on a recording medium such as a DVD and a BD and a character supermarket.
  • the television 10 may further include a reproduction unit (not shown) that reproduces a DVD or a BD.
  • the playback device when a playback device that plays back content recorded on an HDD, DVD, BD, or the like is externally attached to the television 10, it is preferable that the playback device includes a mosaic processing unit 120.
  • the image display device is realized by a playback device such as an HD player, a DVD player, or a BD player.
  • the television 10 may acquire the mosaic image generated in the playback device from the playback device.
  • ⁇ Modification 1> In the present embodiment, the generation of the superimposed mosaic image when the object is a character supermarket has been described. However, the present invention is not limited to this, and the cursor for selecting a partial image in the puzzle game and An arrow or the like may be used.
  • FIG. 7 is a diagram schematically illustrating the flow of the mosaiced image generation process according to the modification of the present embodiment.
  • FIG. 7A shows an example of a frame image before the superimposed mosaiced image generation processing is performed
  • FIG. 7B shows an example of a reverse mosaiced cursor and arrow
  • FIG. 7C shows a superimposed mosaiced image. An example of a superimposed mosaic image that has been subjected to generation processing is shown.
  • the puzzle game shown in FIG. 7C is an example of a puzzle game in which partial images are divided into a total of 16 pieces of 4 rows and 4 columns. Specifically, in the image subjected to the superimposed mosaic image processing, the black image arranged in one block is selected by the user from the partial images arranged in the block adjacent to the black image. It is a puzzle game which returns to the image before a mosaic image generation process is performed by repeating the operation of replacing the selected partial image.
  • the television 10 generates a puzzle game as shown in (c) by superimposing a cursor and a black image on a partial image obtained by dividing the frame image shown in FIG. Further, the black image superimposed on the partial image includes an arrow as shown in FIGS. 7B and 7C.
  • the mosaic processing unit 120 of the television 10 according to the present modification and each unit included in the mosaic processing unit 120 perform the superimposed mosaiced image generation process as follows, for example, as illustrated in FIG.
  • the puzzle game shown in (c) is generated.
  • the mosaic processing unit 120 When receiving the puzzle display instruction, the mosaic processing unit 120 starts the mosaic image generation process.
  • the mosaic processing unit 120 acquires the puzzle display instruction, first, it is associated with the puzzle game specified in the acquired puzzle display instruction (the puzzle game shown in FIG. 7C) as the arrangement reference frame.
  • the puzzle frame is read from the storage unit.
  • the mosaic processing unit 120 When the mosaic processing unit 120 reads out the puzzle frame, the mosaic processing unit 120 generates an arrangement table for determining which of the partial images is arranged in which block of the puzzle frame. At this time, it is preferable that the arrangement table also shows a block in which a black image is arranged and a block in which a cursor is arranged.
  • the inverse mosaicing unit 121 included in the mosaic processing unit 120 acquires cursor data indicating a cursor for superimposing (arranging) on the partial image. Then, the inverse mosaicing unit 121 refers to the arrangement table, and generates an inverse mosaiced object in which the cursor indicated by the acquired cursor data is arranged (inverse mosaicing processing) in the corresponding block of the puzzle frame. At this time, the inverse mosaicing unit 121 generates a black image including an arrow together with the inverse mosaiced object.
  • the superimposing unit 122 acquires a frame image (for example, FIG. 7A) stored in the graphic buffer 106, and converts the acquired frame image into a block included in the puzzle frame.
  • the image is divided into a plurality of partial images so that they can be arranged.
  • the superimposing unit 122 superimposes the de-mosaic object on the frame image divided into the partial images.
  • the partial image on which the inverse mosaicked object is superimposed is as shown in FIG. 7B, for example.
  • the mosaicing unit 123 refers to the arrangement table, arranges the partial image on which the inverse mosaicked object is superimposed on the corresponding block of the puzzle frame (mosaicing process), and converts the black image including the arrow into the partial image.
  • a superimposed mosaic image is generated that is superimposed on the image.
  • the superimposed mosaic image is, for example, as shown in FIG.
  • the television 10 performs the above-described processing in the mosaic processing unit 120, thereby moving the cursor to blocks adjacent to the left, right, top, and bottom of the block displaying the black image as illustrated in FIG. Generate a puzzle game in which is placed.
  • the mosaic processing unit 120 sequentially acquires the frame images sequentially stored in the graphic buffer and repeatedly executes the above-described processing. Thereby, since the partial image arrange
  • the mosaic processing unit 120 may further blink the cursor and the arrow displayed in the puzzle game. More specifically, the mosaic processing unit 120 causes the inverse mosaicing unit 121 included in the mosaic processing unit 120 to function as a display mode changing unit that periodically changes the display mode of the UI element. Blinks the cursor and arrow.
  • FIG. 8 is a graph showing an example of the blinking cycle of the cursor and the arrow displayed in the puzzle game according to this modification.
  • FIG. 8A shows an example of the blinking cycle of the cursor
  • FIG. 8B shows an example of the blinking cycle of the arrow.
  • the inverse mosaicing unit 121 included in the mosaic processing unit 120 operates to periodically blink the brightness of the cursor and the arrow within a predetermined brightness range. At this time, the inverse mosaicing unit 121 may operate such that the blinking cycle of the cursor is different from the blinking cycle of the arrow.
  • the inverse mosaicing unit 121 makes the cursor of the puzzle game according to the present modification brighter stepwise (for example, every 1V period) from the lower limit to the upper limit of the predetermined brightness range. After the brightness reaches the upper limit, it operates so as to gradually darken from the upper limit to the lower limit. In addition, after the brightness of the cursor reaches the lower limit, the inverse mosaicing unit 121 operates so that the brightness is gradually increased again from the lower limit to the upper limit. The inverse mosaicing unit 121 periodically blinks the cursor by repeating the above operation.
  • the inverse mosaicing unit 121 changes the brightness of the cursor included in the inverse mosaiced object to the cursor included in the inverse mosaiced object generated immediately before the brightness of the cursor displayed in the puzzle game. Change the brightness step by step. Thereby, the de-mosaic unit 121 can periodically blink the cursor as described above.
  • the inverse mosaicing unit 121 gradually increases the brightness of the arrow of the puzzle game according to this modification from the lower limit to the upper limit of the predetermined brightness range. After reaching, it works to darken instantaneously from the upper limit to the lower limit. In addition, after the brightness of the arrow reaches the lower limit, the inverse mosaicing unit 121 operates so that the brightness gradually increases again from the lower limit to the upper limit. The inverse mosaicing unit 121 periodically blinks the arrow by repeating the above operation.
  • the inverse mosaicing unit 121 also performs the brightness of the arrow when the arrangement position of the black image and the selected partial image displayed in the puzzle game is exchanged (“panel movement occurrence” shown in FIG. 8B). Is made darker than the lower limit of the predetermined brightness range. As a result, the arrows can be made inconspicuous while the arrangement positions of the black image and the selected partial image are changed.
  • the demosaicization unit 121 in the demosaicization unit 121, the configuration in which the cursor and the arrow are periodically blinked by changing the brightness of the cursor and the arrow in steps has been described as an example.
  • the method of changing is not limited to this.
  • the inverse mosaicing unit 121 may periodically change the color of the cursor and the arrow, or may periodically change both the brightness and the color of the cursor and the arrow.
  • FIG. 9 is a diagram schematically illustrating an example of a puzzle game according to the present modification.
  • FIG. 9A schematically shows an example of a puzzle game according to this modification
  • FIGS. 9B and 9C show an example of the blinking cycle of the cursor.
  • the puzzle game shown in FIG. 9A is a selected partial image selected by the cursor ⁇ and a selected partial image selected by the cursor ⁇ among the partial images divided into a total of 16 pieces of 4 rows and 4 columns. It is an example of the puzzle game which returns to the image before performing the mosaic image generation process by repeating the operation of changing the arrangement position.
  • the mosaic processing unit 120 blinks the cursor ⁇ and the cursor ⁇ displayed in the puzzle game.
  • the blinking of the cursor ⁇ and the cursor ⁇ displayed in the puzzle game shown in FIG. 9A will be described with reference to FIGS. 9B and 9C.
  • the inverse mosaicing unit 121 included in the mosaic processing unit 120 operates so as to periodically blink the brightness of the cursor ⁇ and the cursor ⁇ within a predetermined brightness range. To do. At this time, the inverse mosaicing unit 121 may operate so that the blinking cycle of the cursor ⁇ is different from the blinking cycle of the cursor ⁇ . By making the blinking cycles of the cursor ⁇ and the cursor ⁇ different, it is possible to make the partial images focused on the cursor ⁇ and the cursor ⁇ stand out.
  • the inverse mosaicing unit 121 may blink the brightness of the cursor ⁇ and the cursor ⁇ so that the period is the same and the phase is inverted. Specifically, the inverse mosaicing unit 121 blinks the cursor ⁇ and the cursor ⁇ so that the cursor ⁇ is dark when the cursor ⁇ is bright and the cursor ⁇ is bright when the cursor ⁇ is dark. Thereby, the partial images focused on the cursor ⁇ and the cursor ⁇ can be made conspicuous.
  • the blinking operation of the cursor ⁇ and the cursor ⁇ in the inverse mosaicing unit 121 is the same as the operation of the inverse mosaicing unit 121 according to the first modification, and thus description thereof is omitted here.
  • FIG. 10 is a diagram schematically illustrating the flow of the mosaiced image generation process according to this modification.
  • FIG. 10A shows an example of a frame image before the superimposed mosaiced image generation process is performed
  • FIG. 10B shows an example of a reverse mosaiced cursor and arrow
  • FIG. 10C shows a superimposed mosaiced image. An example of a superimposed mosaic image that has been subjected to generation processing is shown.
  • the user selects a partial image arranged in a certain block with the cursor in the image subjected to the superimposed mosaic image processing, and the selected portion. Select the direction to move the image by selecting the arrow. Accordingly, all partial images belonging to the column or row along the direction indicated by the selected arrow are adjacent to the block in which each partial image is arranged and are adjacent to the direction indicated by the selected arrow. Relocated to block.
  • the edge block on the direction side indicated by the selected arrow includes: There is no adjacent block in the direction indicated by the selected arrow.
  • the edge block on the side opposite to the edge block indicated by the arrow selected by the user may be regarded as a block adjacent in the direction indicated by the selected arrow.
  • the partial image that does not belong to the direction in which the partial image selected by the cursor can move is more than the partial image that belongs to the direction in which the partial image selected by the cursor can move. It appears dark.
  • the inverse mosaicing unit 121 included in the mosaicing processing unit 120 generates a superimposed image with low transmittance, and the superimposing unit 122 superimposes the superimposed image on the corresponding partial image, thereby superimposing the superimposed image.
  • the image can be displayed darkly.
  • the mosaic processing unit 120 of the television 10 according to this modification and each unit included in the mosaic processing unit 120 execute the superimposed mosaiced image generation process as follows, for example, as illustrated in FIG. A puzzle game shown in FIG.
  • the mosaic processing unit 120 When the mosaic processing unit 120 receives a puzzle display instruction, the mosaic processing unit 120 starts a mosaic image generation process.
  • the mosaic processing unit 120 acquires the puzzle display instruction, first, it is associated with the puzzle game specified in the acquired puzzle display instruction (puzzle game shown in FIG. 10C) as an arrangement reference frame.
  • the puzzle frame is read from the storage unit.
  • the mosaic processing unit 120 When the mosaic processing unit 120 reads out the puzzle frame, it generates an arrangement table. At this time, it is preferable that the arrangement table also shows a block in which the superimposed image is arranged and a block in which the cursor is arranged.
  • the inverse mosaicing unit 121 acquires cursor data indicating a cursor to be superimposed (arranged) on the partial image and superimposed image data indicating the superimposed image. Then, the inverse mosaicing unit 121 refers to the placement table, and places the cursor indicated by the acquired cursor data and the superimposed image indicated by the superimposed image data on the corresponding block of the puzzle frame (inverse mosaicing). Generate a generalized object.
  • the superimposing unit 122 acquires a frame image (for example, FIG. 10A) stored in the graphic buffer 106, and converts the acquired frame image into a block included in the puzzle frame.
  • the image is divided into a plurality of partial images so that they can be arranged.
  • the superimposing unit 122 superimposes the de-mosaic object on the frame image divided into the partial images.
  • the partial image on which the inverse mosaicked object is superimposed is, for example, as shown in FIG.
  • the mosaic unit 123 refers to the arrangement table, and generates a superimposed mosaic image in which the partial image on which the inverse mosaic object is superimposed is arranged (mosaiced) in the corresponding block of the puzzle frame.
  • the superimposed mosaic image is, for example, as shown in FIG.
  • the mosaic processing unit 120 sequentially acquires the frame images sequentially stored in the graphic buffer 106 and repeatedly executes the above-described processing, whereby the partial images arranged in each block are sequentially updated.
  • the game can be realized by moving images.
  • the mosaic processing unit 120 may further move the display position of the arrow displayed in the puzzle game. More specifically, the mosaic processing unit 120 causes the inverse mosaicing unit 121 included in the mosaic processing unit 120 to function as a display mode changing unit that periodically changes the display mode of the UI element. The display position of the arrow may be moved.
  • FIG. 11 is a diagram schematically illustrating an example of movement of an arrow displayed in the puzzle game according to the present modification.
  • FIG. 11A schematically shows an example of arrow movement
  • FIG. 11B shows an example of the period of arrow movement.
  • FIG. 12 is a diagram schematically showing the movement of the arrow when the key guidance of the remote controller 20 is displayed in the puzzle game according to this modification.
  • FIG. 12A shows an example when the arrow is hidden in the key guidance
  • FIG. 12B shows an example when the arrow is not hidden in the key guidance.
  • the de-mosaic unit 121 operates to periodically move the display position of the arrow displayed in the partial image selected by the cursor in the partial image. To do.
  • the inverse mosaicing unit 121 gradually changes the display position of the arrow of the puzzle game according to the present modification from the inside to the outside in the partial image (for example, 1 cycle), and after the display position of the tip of the arrow reaches the edge of the partial image, it operates to move instantaneously from the outside to the inside. Then, after the display position of the arrow is moved from the outside to the inside, the inverse mosaicing unit 121 operates such that the display position of the arrow is gradually moved again from the inside to the outside.
  • the inverse mosaicing unit 121 displays the arrow display position. May be fixed at the display position where the tip of the arrow is located at the edge of the partial image. Thereby, the arrow can be made inconspicuous while the partial image is moving.
  • the arrow is hidden by the key guidance of the remote controller 20 displayed at the bottom of the display screen as shown in FIG. Even so, the entire arrow can be displayed by key guidance as shown in FIG.
  • the television 10 ′ according to the present embodiment has the same configuration as that of the television 10 according to the first embodiment, except that the mosaic processing unit 130 is provided instead of the mosaic processing unit 120. It is a configuration.
  • FIG. 13 is a block diagram illustrating a main configuration of the mosaic processing unit 130 included in the television 10 ′ according to the present embodiment.
  • the mosaic processing unit 130 When the mosaic processing unit 130 receives a remote control signal (superimposed mosaic image display instruction) indicating a user instruction to display a superimposed mosaic image via the remote control receiver 108, the mosaic processing unit 130 is designated in the superimposed mosaic image display instruction.
  • An arrangement reference frame associated with a mosaiced image is read from a storage unit (not shown). Further, when reading the arrangement reference frame, the mosaic processing unit 130 generates an arrangement table for determining which of the partial images is arranged for which block of the arrangement reference frame.
  • the mosaic processing unit 130 sequentially transmits, to the display control unit 109, the graphic plane in which the frame images subjected to the superimposed mosaic image generation processing in each unit of the mosaic processing unit 130 are arranged in the blocks included in the arrangement reference frame. Supply.
  • the mosaic processing unit 130 includes a mosaic unit (mosaic unit) 131 and a superimposing unit (superimposed image generation unit, display mode control unit) 132.
  • the mosaic unit 131 divides the frame image into a plurality of partial images, and creates a mosaic frame image by exchanging the partial images.
  • the mosaicing unit 131 first sequentially reads the frame images stored in the graphic buffer 106, and divides the read frame images into a plurality of partial images according to the arrangement reference frame. Then, the mosaic unit 131 refers to the arrangement table and generates a mosaic frame image (mosaic image) from the partial image.
  • a mosaic frame image mosaic image
  • the superimposing unit 132 generates a superimposed mosaiced image (superimposed image) by superimposing the object read from the object buffer 107 on the mosaiced frame image generated by the mosaicing unit 131.
  • the mosaic processing unit 130 can also cause the superimposing unit 132 to function as a display mode changing unit that periodically changes the display mode of UI elements.
  • the mosaic processing unit 130 can change the display mode of the UI element, but the configuration is different from each modification of the first embodiment. Since it is the same, the detailed description is abbreviate
  • FIG. 14 is a flowchart showing the flow of the superimposed mosaic image generation process in the mosaic processing unit 130 included in the television 10 ′ according to the present embodiment.
  • the mosaic processing unit 130 When the mosaic processing unit 130 receives the mosaic image display instruction, the mosaic processing unit 130 starts the superimposed mosaic image generation process shown in FIG.
  • the arrangement reference frame specified in the acquired mosaic image display instruction is stored from the storage unit (not illustrated). Read (step S201).
  • the mosaic processing unit 130 When the mosaic processing unit 130 reads the placement reference frame, the mosaic processing unit 130 generates a placement table (step S202).
  • the mosaic processing unit 130 may determine the arrangement table at random each time, or may determine according to the designated difficulty level when the difficulty level of the puzzle game is designated in the puzzle display instruction. .
  • the mosaicing unit 131 included in the mosaicing processing unit 130 acquires a frame image stored in the graphic buffer 106, and a plurality of frame images can be arranged in a block included in the arrangement reference frame.
  • the image is divided into partial images (step S203).
  • the mosaicing unit 131 refers to the arrangement table and generates a mosaiced frame image in which the partial images are arranged (mosaiced) in the corresponding blocks of the arrangement reference frame (step S204).
  • the mosaicing unit 131 supplies the generated mosaiced frame image to the superimposing unit 132.
  • the superimposing unit 132 reads the object stored in the object buffer 107, and superimposes the read object on the mosaic frame image to generate a superimposed mosaic image (step S205).
  • the configuration in which the mosaicing process is performed after the inverse mosaiced object that has been subjected to the inverse mosaicing process is superimposed on the frame image has been described as an example.
  • the present invention is not limited to this.
  • an object is included in a partial area of a frame image constituting a broadcast program (composite image)
  • only the image of the composite image other than the area including the object is subjected to mosaic processing.
  • a configuration can also be adopted.
  • FIG. 15 is a block diagram illustrating a main configuration of the television 11 according to the present embodiment.
  • components having the same functions as those of the television 10 according to the first embodiment are denoted by the same reference numerals, and description thereof is omitted.
  • differences from the first embodiment will be mainly described.
  • the television 11 according to the present embodiment is the same as the embodiment except that the object buffer 107 is not provided and the mosaic processing unit 140 is provided instead of the mosaic processing unit 120.
  • 1 is the same as the configuration of the television 10 according to FIG.
  • the mosaicing processing unit 140 When the mosaic processing unit 140 receives the mosaiced image display instruction from the remote controller 20, the mosaicing processing unit 140 transmits the arrangement reference frame associated with the mosaiced image specified in the received mosaiced image display instruction from the storage unit (not illustrated). read out. Further, when reading the arrangement reference frame, the mosaic processing unit 140 generates an arrangement table for determining which of the partial images to be arranged in which block of the arrangement reference frame.
  • the mosaic processing unit 140 sequentially transmits, to the display control unit 109, the graphic plane in which the frame images subjected to the superimposed mosaic image generation processing in each unit of the mosaic processing unit 140 are arranged in the blocks included in the arrangement reference frame. Supply.
  • the mosaic processing unit 140 includes an object region detection unit (object region detection unit) 141 and an image region mosaic unit (mosaic unit) 142.
  • the object region detection unit 141 detects an object region including the object from the composite image. Specifically, when an object is included in the composite image read from the graphic buffer 106, an object area is detected from the read composite image.
  • the object area detection unit 141 divides the composite image into an object area and an area (image area) other than the object area.
  • the object area detection by the object area detection unit 141 can be performed using a known technique such as those described in Patent Documents 2 to 5 listed above.
  • the image region mosaicing unit 142 generates a mosaiced image from the images included in the image region divided from the object region by the object region detection unit 141. Further, the image area mosaicing unit 142 combines the generated mosaic image and the object included in the object area to generate a superimposed mosaic image.
  • the image area mosaicing unit 142 divides an image included in the image area into a plurality of partial images and refers to the arrangement table to form a mosaic image by exchanging the partial images. Then, the image region mosaic unit 142 generates a superimposed mosaic image by combining the mosaic image and the objects included in the object region.
  • FIG. 16 is a flowchart showing the flow of the superimposed mosaic image generation process in the mosaic processing unit 140 included in the television 11 according to the present embodiment.
  • FIG. 17 is a diagram schematically showing the flow of the superimposed mosaic image generation process according to this embodiment.
  • the mosaic processing unit 140 When the mosaic processing unit 140 receives the mosaic image display instruction, the mosaic processing unit 140 starts a superimposed mosaic image generation process shown in FIG.
  • the mosaic processing unit 140 when the mosaic processing unit 140 acquires the mosaic image display instruction, first, the mosaic processing unit 140 displays the arrangement reference frame associated with the mosaic image specified in the acquired mosaic image display instruction. Read from the storage unit (step S301).
  • the mosaic processing unit 140 When the mosaic processing unit 140 reads the placement reference frame, the mosaic processing unit 140 generates a placement table (step S302).
  • the mosaic processing unit 140 may randomly determine the arrangement table every time, or may determine according to the specified difficulty level when the puzzle game difficulty level is specified in the puzzle display instruction. .
  • the object area detection unit 141 included in the mosaic processing unit 140 acquires a composite image (for example, a composite image as illustrated in FIG. 17A) stored in the graphic buffer 106, and acquires the acquired composite image.
  • the object area is detected from (step S303).
  • the object region detection unit 141 divides the composite image into the detected object region and the image region.
  • the object region detection unit 141 supplies the frame image divided into the object region and the image region to the image region mosaicing unit 142.
  • the image area mosaicing unit 142 can arrange the plurality of partial images so that the image included in the image area can be arranged in a block included in the arrangement reference frame (Step S304).
  • the image region mosaicing unit 142 refers to the arrangement table, and generates a mosaiced image in which the partial image is arranged (mosaiced) in the corresponding block of the arrangement reference frame. (Step S305).
  • the image region mosaic unit 142 combines the generated mosaic image and the object included in the object region to generate a superimposed object image (step S306).
  • the mosaic processing unit 140 can generate, for example, a superimposed object image as shown in FIG.
  • a broadcast program and an object are acquired, and an object subjected to inverse mosaic processing is superimposed on a frame image that constitutes a video signal representing the broadcast program, and then mosaic processing is performed as an example.
  • the present invention is not limited to this.
  • an object such as a caption
  • the portion hereinafter referred to as “composite image”
  • composite image from the frame image
  • FIG. 18 is a block diagram showing a main configuration of the television 12 according to the present embodiment.
  • components having the same functions as those of the television 10 according to the first embodiment are denoted by the same reference numerals, and description thereof is omitted.
  • differences from the first embodiment will be mainly described.
  • the television 12 according to the present embodiment has the same configuration as that of the television 10 according to the first embodiment, except that an object separation unit (object area separation unit) 111 is provided.
  • object separation unit object area separation unit
  • the object separation unit 111 sequentially acquires frame images constituting the video signal decoded by the decoder 102 from the decoder 102.
  • the object separation unit 111 detects an object area including the object from the frame image. Then, the object separation unit 111 divides (separates) the frame image into an object region and a region other than the object region (in other words, a region not including an object) (hereinafter also referred to as “image region”).
  • FIG. 19 is a diagram schematically illustrating division of an object area and an image area of a frame image in the object separation unit 111 included in the television 12 according to the present embodiment.
  • FIG. 19A shows an example of a frame image that is a composite image
  • FIG. 19B shows an example of a divided image area
  • FIG. 19C shows an example of a divided object area.
  • the object separation unit 111 converts the frame image shown in FIG. 19A into an image included in the image area shown in FIG. 19B and an object included in the object area shown in FIG. 19C (in the example shown in FIG. 19). And subtitles).
  • region containing the subtitles in a frame image can use a well-known technique like the patent document 6 mentioned above, for example.
  • the object separation unit 111 stores the image included in the divided image area in the video buffer 103 and also stores the object included in the object area in the object buffer 107.
  • the object separation unit 111 included in the television 12 divides the object area and the image area from the composite image.
  • the inverse mosaicing unit 121 included in the mosaicing processing unit 120 performs an inverse mosaicing process on the objects included in the object area to generate an inverse mosaiced object.
  • the superimposing unit 122 superimposes the inverse mosaic object on the image included in the image area.
  • the mosaicing unit 123 generates a superimposed mosaiced image by performing a mosaicing process on an image included in the image region and on which an inverse mosaiced object is superimposed.
  • the superimposed mosaiced image generation process in the television 12 includes (1) a target to be subjected to the inverse mosaicing process is an object included in the object area, and (2) a target to be subjected to the mosaicing process is as follows: Similar to the superimposed mosaiced image generation process shown in FIG. 4 in the first embodiment, except that the image included in the image area is an image in which the object included in the object area subjected to the inverse mosaicing process is superimposed. Therefore, detailed description thereof is omitted here.
  • the television 12 according to the present embodiment is included in the object region after the mosaicing process is performed on the image included in the image region, similarly to the superimposed mosaiced image generation processing in the television 10 ′ according to the second embodiment. It is also possible to employ a configuration in which objects to be superimposed are superimposed. In this case, in the superimposed mosaic image generation process, the television 12 generates a superimposed mosaic image by superimposing the object included in the object area on the image included in the image area subjected to the mosaic process. .
  • the television 12 executes the superimposed mosaic image generation process after dividing the object area from the image area even when the object is included in the composite image. be able to.
  • the television 12 according to the present embodiment can prevent the visibility of the object displayed together with the image from being lowered even when the object is included in the frame image.
  • the control blocks (particularly the scaling unit 104, the transfer unit 105, the mosaic processing units 120, 130, 140, and the display control unit 109) of the televisions 10, 10 ′, and 11 are formed in an integrated circuit (IC chip) or the like. It may be realized by a logic circuit (hardware), or may be realized by software using a CPU (Central Processing Unit).
  • IC chip integrated circuit
  • CPU Central Processing Unit
  • the televisions 10, 10 ′, and 11 have a CPU that executes instructions of a program that is software that realizes each function, and a ROM (Read Only Memory) or a storage device (these are referred to as “recording media”), RAM (Random Access Memory) for expanding the program, and the like.
  • a computer or CPU reads the said program from the said recording medium and runs it.
  • the recording medium a “non-temporary tangible medium” such as a tape, a disk, a card, a semiconductor memory, a programmable logic circuit, or the like can be used.
  • the program may be supplied to the computer via an arbitrary transmission medium (such as a communication network or a broadcast wave) that can transmit the program.
  • a transmission medium such as a communication network or a broadcast wave
  • the present invention can also be realized in the form of a data signal embedded in a carrier wave in which the program is embodied by electronic transmission.
  • the image display device includes a mosaicing unit that divides an image into a plurality of partial images and generates a mosaic image by exchanging the partial images, and at least a part of character information received from the outside. Is a display means for displaying the superimposed image superimposed on the mosaic image, and includes a display means for displaying the character information without being mosaicked.
  • the image display device can generate the character information (for example, an earthquake early warning) even when the character information is supplied from the outside when generating the mosaic image from the image. Can be displayed without degrading the visibility of the text superimposing and subtitles).
  • the character information for example, an earthquake early warning
  • the character information in the image display device according to aspect 2 of the present invention may be emergency bulletin.
  • the display means in the image display device according to aspect 3 of the present invention may display the mosaic image as a puzzle game in aspects 1 and 2.
  • the display means in the image display device according to aspect 4 of the present invention displays the UI element to be displayed on the partial image selected from the plurality of partial images in place of the character information in the aspects 1 to 3. May be.
  • the UI element for example, the cursor for focusing the selection target, the arrow indicating the direction of the operation
  • Etc. the UI element
  • the image display device may further include display aspect control means for periodically changing the display aspect of the UI element in aspect 4 above.
  • the display mode control means periodically changes the display mode of the UI element. Therefore, the image display device can make the UI element stand out.
  • the image display device is the image display device according to aspects 1 to 5 described above, wherein the character image representing the character information is divided into a plurality of partial character images, and the reverse mosaiced character image is obtained by replacing the partial character images.
  • the mosaicing unit generates the mosaiced image from an image obtained by superimposing the reverse mosaiced character image on the image, and the inverse mosaicing unit
  • the partial character images may be exchanged so that the character information is not mosaicked in the mosaic image.
  • the said mosaicing means is the said reverse mosaiced character by which the said partial objects were replaced in the said reverse mosaicing means so that the said character information may be arrange
  • the mosaiced image is generated from the image on which the information is superimposed.
  • the mosaicing means is configured such that the character information is on the mosaiced image.
  • a mosaic image superimposed on a specific position can be generated. Therefore, the image display device can prevent a decrease in the visibility of the character information even when the character information is superimposed on the image before generating the mosaic image.
  • the image display device is the superimposed image generation according to any one of aspects 1 to 5, wherein the superimposed image is generated by superimposing the character image representing the character information on the mosaiced image without being mosaicked. Means may be further provided.
  • the superimposed image generating unit generates the superimposed image in which the character information is superimposed at the specific position on the mosaiced image generated by the mosaicing unit.
  • the image display device can prevent a decrease in the visibility of the character information even when displaying the mosaic image.
  • An image display device includes an object area detection unit that detects an object area including the character information from a composite image including an image and character information, and an area other than the object area in the composite image.
  • the image included in the image is divided into a plurality of partial images, and mosaicing means for generating a mosaic image by exchanging the partial images and the character information are displayed in a region different from the region where the mosaic image is displayed. Display means.
  • the mosaicing unit generates the mosaiced image from images included in a region other than the object region detected from the composite image by the object region detection unit.
  • the said image display apparatus displays the said character information contained in the said object area
  • An image display method is an image display method of an image display device, and divides an image into a plurality of partial images and generates a mosaic image by exchanging the partial images.
  • An image display method is an image display method of an image display device, and an object region detection step of detecting an object region including the character information from a composite image including the image and character information; A mosaicing step of dividing an image included in an area other than the object area of the composite image into a plurality of partial images and generating a mosaic image by exchanging the partial images; and the character information as the mosaic image A display step of displaying in a different area from the displayed area.
  • a television receiver according to an aspect 11 of the present invention includes each means of the image display device according to the above aspects 1 to 8.
  • the image display apparatus may be realized by a computer.
  • the image display apparatus is realized by a computer by causing the computer to operate as each unit included in the image display apparatus.
  • a display device program and a computer-readable recording medium on which the program is recorded also fall within the scope of the present invention.
  • An image display device (televisions 10, 10 ′) according to an aspect of the present invention divides an image into a plurality of partial images and generates a mosaic image by exchanging the partial images (mosaicing) ( Superimposing units 122 and 132, mosaicing units 123 and 131), and display means (display control unit 109) for displaying a superimposed image (superimposed mosaiced image) in which an object is superimposed at a specific position on the mosaiced image. It is equipped with.
  • An image display method is an image display method of an image display device (televisions 10 and 10 ′), which divides an image into a plurality of partial images and also converts the partial images into mosaic images. And a display step of displaying a superimposed image (superimposed mosaic image) in which the object is superimposed at a specific position on the mosaic image.
  • the display means displays a superimposed image in which the object is superimposed at a specific position on the mosaic image. Therefore, the image display device can prevent a decrease in the visibility of the object displayed together with the image even when the image is mosaicked.
  • the image display device may display the superimposed image on a display unit provided in the device itself, or may display the superimposed image on a display unit of an external device connected to the device itself. It is not limited.
  • the image display device is the image display device according to the aspect 1, wherein the object is divided into a plurality of partial objects, and inverse mosaicing means (inverse mosaicing) that generates reverse mosaiced objects by exchanging the partial objects. 121), and the mosaicing means generates the mosaiced image from an image in which the inverse mosaicked object is superimposed on the image, and the inverse mosaicing means includes the mosaicing
  • the partial objects may be exchanged so that the objects are arranged at the specific positions in the image.
  • the mosaicing means includes the inverse mosaiced object in which the partial objects are replaced in the inverse mosaicing means so that the object is arranged at the specific position in the mosaiced image.
  • the mosaiced image is generated from the superimposed image.
  • the mosaicing unit does not specify the specific object on the mosaiced image.
  • a mosaic image superimposed on the position can be generated. Therefore, the image display device can prevent the visibility of the object from being lowered even when the object is superimposed on the image before generating the mosaic image.
  • the image display device is the superimposed image generating unit (superimposing unit 132) that generates the superimposed image by superimposing the object on the specific position on the mosaic image in the aspect 1. May be further provided.
  • the superimposed image generation unit generates the superimposed image in which the object is superimposed at the specific position on the mosaiced image generated by the mosaicing unit.
  • the image display device can prevent the visibility of the object from being lowered even when displaying the mosaic image.
  • the object of the image display device may be character information received from the outside in the first to third aspects.
  • the image display device can generate the character information (for example, an earthquake early warning) even when the character information is supplied from the outside when generating the mosaic image from the image. Can be displayed without degrading the visibility of the text superimposing and subtitles).
  • the character information for example, an earthquake early warning
  • the object of the image display device may be a UI element to be displayed on a partial image selected from a plurality of partial images in the first to fourth aspects.
  • the UI element for example, the cursor for focusing the selection target, the arrow indicating the direction of the operation
  • Etc. the UI element
  • the image display apparatus may further include display mode control means (a demosaic unit 121 and a superimposition unit 132) that periodically changes the display mode of the UI element in the mode 5. Good.
  • display mode control means a demosaic unit 121 and a superimposition unit 132
  • the display mode control means periodically changes the display mode of the UI element. Therefore, the image display device can make the UI element stand out.
  • the brightness of the UI element is periodically blinked, the color of the UI element is periodically changed, and the UI element is displayed.
  • the position can be moved periodically.
  • An image display device includes an object area detection unit (object area detection unit 141) that detects an object area including the object from a composite image including an image and an object, and the composite area.
  • object area detection unit 141 object area detection unit 141 that detects an object area including the object from a composite image including an image and an object, and the composite area.
  • a mosaicing means image region mosaicing unit 142) that divides an image included in a region other than the object region of the image into a plurality of partial images and generates a mosaic image by exchanging the partial images
  • the object Display means display control unit 109) for displaying the image in a region different from the region where the mosaic image is displayed.
  • An image display method is an image display method of an image display device (television 11), and an object region detection step of detecting an object region including the object from a composite image including an image and an object.
  • a mosaicing step of dividing an image included in an area other than the object area of the composite image into a plurality of partial images and generating a mosaic image by exchanging the partial images; and mosaicing the object
  • a display step of displaying in a different area from the area where the image is displayed.
  • the mosaicing unit generates the mosaiced image from images included in a region other than the object region detected from the composite image by the object region detection unit.
  • the said image display apparatus displays the said object contained in the said object area
  • the television receiver according to one aspect of the present invention includes each unit of the image display device according to the above aspects 1 to 7.
  • the image display device is the object display unit (object separation unit 111) that separates the object region including the object from the composite image including the image and the object. ) May be further provided.
  • the image display device can prevent a reduction in the visibility of the object displayed together with the image.
  • the image display apparatus may be realized by a computer.
  • the image display apparatus is realized by a computer by causing the computer to operate as each unit included in the image display apparatus.
  • a display device program and a computer-readable recording medium on which the program is recorded also fall within the scope of the present invention.
  • the image display device can be suitably used for a television receiver, a mobile phone, a smartphone, a tablet terminal, and the like.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Databases & Information Systems (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Physics & Mathematics (AREA)
  • Computer Hardware Design (AREA)
  • Controls And Circuits For Display Device (AREA)
  • Image Processing (AREA)
  • Transforming Electric Information Into Light Information (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

　Conformément à un mode de réalisation, la présente invention concerne une télévision (10, 10') qui comporte une unité de superposition (122, 132) et une unité de présentation en mosaïque (123, 131) pour diviser une image en une pluralité d'images partielles et générer une image présentée en mosaïque par remplacement des images partielles par d'autres, et une unité de commande d'affichage (109) pour afficher une image présentée en mosaïque superposée dans laquelle au moins certaines informations de caractère reçues à partir de l'extérieur sont superposées sur l'image présentée en mosaïque, les informations de caractère n'étant pas présentées en mosaïque lorsqu'elles sont affichées par l'unité de commande d'affichage (109).
PCT/JP2014/077041 2013-10-18 2014-10-09 Dispositif d'affichage d'image, procédé d'affichage d'image, récepteur de télévision, programme et support d'enregistrement WO2015056622A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2013-217476 2013-10-18
JP2013217476A JP5815633B2 (ja) 2013-10-18 2013-10-18 画像表示装置、画像表示方法、テレビジョン受像機、プログラム、及び、記録媒体

Publications (1)

Publication Number Publication Date
WO2015056622A1 true WO2015056622A1 (fr) 2015-04-23

Family

ID=52828068

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2014/077041 WO2015056622A1 (fr) 2013-10-18 2014-10-09 Dispositif d'affichage d'image, procédé d'affichage d'image, récepteur de télévision, programme et support d'enregistrement

Country Status (2)

Country Link
JP (1) JP5815633B2 (fr)
WO (1) WO2015056622A1 (fr)

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2003116128A (ja) * 2001-10-04 2003-04-18 Toshiba Corp 画像データの圧縮構造、データ処理方法、及び情報端末
JP2005242204A (ja) * 2004-02-27 2005-09-08 Matsushita Electric Ind Co Ltd 情報表示方法及び情報表示装置
WO2006040998A1 (fr) * 2004-10-08 2006-04-20 Matsushita Electric Industrial Co., Ltd. Dispositif d'affichage video
JP2007222509A (ja) * 2006-02-24 2007-09-06 Fujifilm Corp 画像再生装置及び撮像装置
JP2010213997A (ja) * 2009-03-18 2010-09-30 Nikon Corp データ送信装置およびデジタルカメラ
JP2013009057A (ja) * 2011-06-22 2013-01-10 Sharp Corp マルチディスプレイシステム

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2003116128A (ja) * 2001-10-04 2003-04-18 Toshiba Corp 画像データの圧縮構造、データ処理方法、及び情報端末
JP2005242204A (ja) * 2004-02-27 2005-09-08 Matsushita Electric Ind Co Ltd 情報表示方法及び情報表示装置
WO2006040998A1 (fr) * 2004-10-08 2006-04-20 Matsushita Electric Industrial Co., Ltd. Dispositif d'affichage video
JP2007222509A (ja) * 2006-02-24 2007-09-06 Fujifilm Corp 画像再生装置及び撮像装置
JP2010213997A (ja) * 2009-03-18 2010-09-30 Nikon Corp データ送信装置およびデジタルカメラ
JP2013009057A (ja) * 2011-06-22 2013-01-10 Sharp Corp マルチディスプレイシステム

Also Published As

Publication number Publication date
JP2015079209A (ja) 2015-04-23
JP5815633B2 (ja) 2015-11-17

Similar Documents

Publication Publication Date Title
JP5337920B1 (ja) 表示装置、表示装置の制御方法、テレビジョン受像機、制御プログラム、および記録媒体
EP3099081B1 (fr) Appareil d'affichage et son procédé de commande
US9426412B2 (en) Rendering device and rendering method
JP2011160152A (ja) 映像出力装置及び映像出力方法
JP2014077993A (ja) 表示装置
JP6045405B2 (ja) 映像処理装置、表示装置、テレビジョン受信機及び映像処理方法
US20190027077A1 (en) Electronic device and method
EP2063636A1 (fr) Dispositif de traitement vidéo et procédé de traitement vidéo
JP5815633B2 (ja) 画像表示装置、画像表示方法、テレビジョン受像機、プログラム、及び、記録媒体
CN107743710B (zh) 显示装置及其控制方法
JP2008122507A (ja) 画面表示処理装置、映像表示装置、ｏｓｄ表示方法
JP2005532743A (ja) 表示される画像の一部を隠すシステムおよび方法
JP5797312B2 (ja) 動画像表示制御装置、表示制御方法、テレビジョン受像機、プログラム、及び、記録媒体
JP4420035B2 (ja) 放送受信装置
JP2015056019A (ja) 表示装置および表示方法
JP5192325B2 (ja) 映像再生装置及び映像再生方法
JP2006253925A (ja) 表示制御装置及び番組録画装置
JP2015099340A (ja) 画像表示装置、テレビジョン受像機、画像表示方法、プログラム、及び、記録媒体
JP5719006B2 (ja) 画像表示装置、画像表示装置の制御方法、テレビジョン受像機、プログラム、及び記録媒体
JP4550942B2 (ja) チャンネル登録装置およびチャンネル登録方法
JP5534948B2 (ja) 画像処理装置及びその制御方法
JP2013101266A (ja) 表示装置及び表示方法
JP2009200937A (ja) デジタル放送受信機
JP2011066539A (ja) 番組情報の表示制御装置及び番組情報の表示制御方法
JP2015159551A (ja) 画像表示装置、画像表示装置の制御方法、テレビジョン受像機、プログラム、及び記録媒体

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 14853219

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 14853219

Country of ref document: EP

Kind code of ref document: A1