JP5747114B2 - Image display device, image display method, and program - Google Patents

Description

  The present invention relates to an image display device, an image display method, and a program suitable for, for example, a smartphone.

  Recently, small computer terminals having a cellular phone function, which are collectively referred to as smartphones, are widely used. Most smartphones of this type do not require general key input or a stylus, and use a touch screen method that directly touches icons, keyboards, buttons, etc. on the screen with your finger. Various technologies according to the above have been proposed. (For example, Patent Document 1)

JP 2012-108674 A

  One of the basic operations of a smartphone touch screen system is a technique called “flick” in which a screen is quickly and vertically moved with a finger. By performing this operation, the range of the image displayed on the screen can be quickly moved.

  However, by quickly moving the image to be displayed, the load required for drawing processing on the terminal side is large, so that the memory consumption is large, especially when the computing performance of the hardware of the terminal such as a graphics processor is low, There is a demand for a technique that reduces some kind of load, for example, a user's intended operational feeling cannot be obtained in terms of moving speed.

  The present invention has been made in view of the above circumstances, and an object of the present invention is to provide an image display device, an image display method, and a program capable of sufficiently reducing a load applied when moving an image displayed on a screen. It is to provide.

One embodiment of the present invention is an image display method in an apparatus including a display unit that displays an image and a touch input unit that is provided integrally with the display unit and receives a touch operation. In response to the touch operation instructing the moving direction received in step 1, the image acquisition step of acquiring an image corresponding to the moving direction, and the resolution for reducing the resolution of the image corresponding to the moving direction acquired in the image acquiring step in units of basic blocks A conversion step, a display control step for displaying an image corresponding to the moving direction whose resolution has been reduced by the resolution converting step, while moving in the moving direction received by the touch input unit, and a touch for instructing the moving direction Based on the moving speed detecting step for detecting the moving speed of the operation and the moving speed of the touch operation detected by the moving speed detecting step, the size of the basic block is changed. ; And a size changing step, the resolution conversion process, the display control step, the moving speed detection step and resizing process is run based on the type of touch operation based on the moving speed of the touch operation accepted by the touch input unit An image display method in which presence or absence is selected .

  According to the present invention, it is possible to sufficiently reduce the load applied when moving an image displayed on a screen.

The block diagram which shows the functional circuit structure of the smart phone which concerns on one Embodiment of this invention. The flowchart which shows the processing content with respect to movement operation with the touchscreen which concerns on the same embodiment. The figure which simplifies and shows the content of the resolution conversion of the image data which concerns on the embodiment.

  Hereinafter, an embodiment when the present invention is applied to a smartphone will be described with reference to the drawings.

  FIG. 1 is a block diagram illustrating a functional circuit configuration of the smartphone 10 according to the present embodiment. In the figure, reference numeral 11 denotes a CPU that supervises control operations in the smartphone 10, and is configured by integrating a cache memory, a GPU (Graphics Processing Unit), and the like into one chip.

  For this CPU 11, via the system bus SB, the main memory 12, the storage unit 13, the wide area communication unit 14, the short-range communication unit 15, the display controller 16, the touch panel controller 17, the transmission / reception processing unit 18, the captured image processing unit 19, And the sensor group 20 is connected.

  The main memory 12 is composed of, for example, a DRAM and functions as a work memory for the CPU 11. The main memory 12 may be configured as one chip together with the CPU 11. The storage unit 13 is configured by a semiconductor memory such as an HDD (hard disk device) or a flash memory, for example, and is a medium for storing all operation programs including an OS and applications, various data, and the like.

  The wide area communication unit 14 corresponds to each communication system of 2G (GSM (registered trademark) / GPRS / EDGE) and 3G (W-CDMA / CDMA2000 1xMC / CDMA2000 1xEV-DO), and is not illustrated through an antenna 21. Cellular data is transmitted to and received from the base station.

  The short-range communication unit 15 corresponds to a communication system of Wi-Fi (IEEE802.11b / g / n) and Bluetooth (registered trademark) 4.0-HS, and is not illustrated in the short distance via the antenna 22. Data communication between compatible devices.

  The display controller 16 drives the display 23 composed of a color TFT liquid crystal panel with a backlight having a diagonal ratio of 3.52 and an aspect ratio of 3: 2, for example, based on image data given through the system bus SB. Is displayed.

  The touch panel controller 17 drives a touch panel 24 that is integrally formed on the display 23, calculates coordinates indicating an operation position according to a touch operation including a multi-touch of the user, and sends it to the CPU 11 as an operation signal. .

  The transmitter / receiver processing unit 18 connects the microphone 25 of the transmitter and the speaker 26 of the receiver, converts the voice signal input from the microphone 25 during voice communication into digital data, and transmits it from the wide area communication unit 14. The digital data of the other party's voice is converted to analog and the loudspeaker 26 emits sound.

  The photographed image processing unit 19 drives a solid-state image sensor 28 composed of, for example, a CMOS image sensor at the time of the camera function, acquires focused image data via the photographing lens 27, and JPEG is used for still image photographing. For file and video shooting, the data is compressed into an MPEG file.

  The sensor group 20 is, for example, a proximity sensor for detecting that the (user's) ear is near the housing of the smartphone 10, and a luminance for detecting ambient brightness and adjusting the light emission luminance on the display 23. A sensor, a three-axis acceleration sensor for detecting the orientation of the housing of the smartphone 10, a geomagnetic sensor for detecting the orientation as a digital compass, and the like are output to the CPU 11 as necessary.

Next, the operation of the above embodiment will be described.
FIG. 2 shows the processing executed by the CPU 11 in response to an operation in which the user moves the touch panel 24 in any direction up, down, left, or right with respect to the image displayed on the display 23.

  Initially, the CPU 11 waits for an input operation from the touch panel controller 17 to be operated on the touch panel 24 (step S01), and when it is determined that the operation has been performed, a process of moving and displaying the image is performed. Start.

  First, after confirming that the movement of the image has not been completed (step S02), image data to be displayed in the operated direction is acquired (step S03). Here, after confirming that the processing for each block of the image data has not been completed (step S04), the first block is extracted from the acquired image data (step S05).

FIG. 3 is a diagram showing simplified processing in units of blocks constituting the image data.
For example, when the image data has a configuration with an aspect ratio of 3: 4 of vertical 120 pixels × horizontal 160 pixels, a predetermined square block, for example, vertical 4 pixels × horizontal 4 pixels, is extracted as a basic block from the upper left, and each of these pixels is extracted. An average value of gradation is calculated (step S06).

  FIG. 3A shows a basic block that is the first processing target (at the upper left corner) when the basic block is 2 vertical pixels × 2 horizontal pixels in order to simplify the concept of the present embodiment. . The average value of the gradation of each pixel in the block shown in this way is calculated by rounding off and handled as the representative value of the block.

  Actually, since each pixel constituting the color image data to be displayed has independent gradation values of R, G, and B, the same processing is performed for each gradation of R, G, and B. However, the explanation is simplified here.

  FIG. 3B shows the configuration of the image data in which the average value is calculated for each block in this way. As described above, when the basic block is 4 vertical pixels × 4 horizontal pixels, the image data of vertical 120 pixels × horizontal 160 pixels has a configuration of vertical 30 blocks × horizontal 40 blocks, and the average value of gradation for each block. Is calculated as a representative value of the block.

  In accordance with the result of calculating the average value, after replacing all pixels in the block with the calculated average value (step S07), the process returns to step S04 again to perform the same process for the next block.

  In this way, the processing in steps S04 to 07 is repeatedly executed for the number of blocks, and when the processing for all the blocks is completed, it is determined in subsequent step S04, and the simplified processing with reduced resolution based on the calculated average value is moved. An intermediate image is displayed on the display 23 (step S08).

  FIG. 3C shows the contents of the simplified image data with a reduced resolution displayed in the middle of movement. In the case where a vertical block of 4 pixels × horizontal 4 pixels is used as a basic block, the gradation value of the pixel is actually averaged in units of the block. Here, however, the vertical values follow FIGS. 3A and 3B above. An example in which 2 × 2 horizontal pixels are used as a basic block is shown as an average value.

  In this way, after displaying the simple image in the middle of the movement according to the movement operation, it is determined in step S02 whether or not it is necessary to display a further next movement image based on the speed of the movement operation and the stroke amount. If so, the processes in and after step S03 are repeated.

  Then, the same processing is repeatedly executed by the number corresponding to the speed of the user's moving operation and the stroke amount, and the simple images during the movement are sequentially displayed on the display 23.

  Thereafter, when the display of the simple image in the middle of the movement is finished, the CPU 11 that has determined that in step S02 acquires image data to be displayed after the movement (step S09).

  The acquired image data is displayed on the display 23 while maintaining the original resolution as it is without making it a simple image due to the above-described reduction in resolution (step S10). In order to prepare for this operation, the process returns to step S01.

  As described above in detail, according to the present embodiment, the image to be displayed during the movement of the image is intentionally reduced in resolution, and the amount of image data is greatly reduced and handled. By displaying a simple image only for an image in the middle of movement, it is possible to greatly reduce the load related to the CPU 11 and the GPU that performs image drawing in the CPU 11 and the control of the memory used for graphics.

  Note that the user's movement operation on the touch panel 24 is not a slow “slide” operation that traces the screen, but is a quick “flick” that is operated at a speed higher than a preset speed. The processing shown in FIG. 2 described above may be executed to reduce the load on the CPU 11 side that controls the display operation in response to the operation, and the load required on the CPU 11 side. Whether or not to execute control can be selected according to the degree.

  Although not described in the above embodiment, regarding the user's movement operation on the touch panel 24, the movement speed is detected and recognized stepwise, and the basics when the resolution of the image is reduced based on the recognized result. The block size may be variably set.

  In this case, the faster the moving operation is, the larger the size of the basic block is set, and the resolution is further reduced, thereby reducing the burden on the CPU 11 when the moving display of the image needs to be accelerated. However, the operation according to the present embodiment can be optimized within a range in which the image quality deterioration is not noticeable.

  In addition, although the said embodiment demonstrated the case where this invention is applied to a smart phone, this invention is not restricted to this, If it is an apparatus which operates the movement of an image with the touchscreen integrated with the display, The present invention is similarly applicable to user interfaces of various devices such as tablet terminals and various mobile devices.

  In addition, the present invention is not limited to the above-described embodiments, and various modifications can be made without departing from the scope of the invention in the implementation stage. Further, the functions executed in the above-described embodiments may be combined as appropriate as possible. The above-described embodiment includes various stages, and various inventions can be extracted by an appropriate combination of a plurality of disclosed constituent elements. For example, even if some constituent requirements are deleted from all the constituent requirements shown in the embodiment, if the effect is obtained, a configuration from which the constituent requirements are deleted can be extracted as an invention.

  DESCRIPTION OF SYMBOLS 10 ... Smartphone, 11 ... CPU, 12 ... Main memory, 13 ... Storage part, 14 ... Wide area communication part, 15 ... Short-range communication part, 16 ... Display controller, 17 ... Touch panel controller, 18 ... Transmission / reception processing part, 19 ... Captured image processing unit, 20 ... sensor group, 21, 22 ... antenna, 23 ... display, 24 ... touch panel, 25 ... microphone, 26 ... speaker, 27 ... shooting lens, 28 ... solid-state imaging device, SB ... system bus.

Claims (5)

An image display method in an apparatus including a display unit that displays an image and a touch input unit that is provided integrally with the display unit and receives a touch operation,
An image acquisition step of acquiring an image according to the movement direction in response to a touch operation instructing a movement direction received by the touch input unit;
A resolution conversion step for reducing the resolution in units of basic blocks according to the moving direction acquired in the image acquisition step;
A display control step of displaying an image corresponding to the movement direction reduced in resolution by the resolution conversion step while moving in the movement direction received by the touch input unit;
A moving speed detecting step of detecting the moving speed of the touch operation instructing the moving direction;
A size changing step for changing the size of the basic block based on the moving speed of the touch operation detected by the moving speed detecting step ;
Whether the resolution conversion step, the display control step, the movement speed detection step, and the size change step are performed is selected based on the type of touch operation based on the movement speed of the touch operation received by the touch input unit.
Image display method. The type of touch operation for instructing the movement direction may include a slide operation to operate at a slower than the moving speed is a flick operation, and the preset operating at higher speeds a preset moving speed velocity,
2. The image display method according to claim 1 , wherein the selection step selects execution of the resolution conversion step, the display control step, the movement speed detection step, and the size change step when the flick operation is performed. . The image display method according to claim 1, wherein the resolution conversion step variably sets a degree of resolution reduction of the image according to a moving speed of the touch operation detected by the touch input unit. A display for displaying an image;
A touch input unit that is provided integrally with the display unit and receives a touch operation;
In response to a touch operation instructing a moving direction received by the touch input unit, an image acquisition unit that acquires an image according to the moving direction, and an image according to the moving direction acquired by the image acquisition unit in units of basic blocks. Resolution conversion means for reducing the resolution;
Display control means for displaying an image corresponding to the moving direction whose resolution has been reduced by the resolution converting means during the movement in the moving direction received by the touch input unit, and the moving speed of the touch operation for instructing the moving direction. A moving speed detecting means for detecting;
A size changing means for changing the size of the basic block based on the moving speed of the touch operation detected by the moving speed detecting means ;
Selection means for selecting whether or not to execute the resolution conversion means, display control means, movement speed detection means, and size change means based on the type of touch operation based on the movement speed of the touch operation received by the touch input unit; An image display device comprising: A program executed by a computer built in a device including a display unit that displays an image and a touch input unit that is provided integrally with the display unit and receives a touch operation,
In the above computer,
In response to a touch operation instructing a moving direction received by the touch input unit, an image acquiring step for acquiring an image corresponding to the moving direction, and an image corresponding to the moving direction acquired in the image acquiring step in units of basic blocks. A resolution conversion step to lower the resolution;
A display control step for displaying an image corresponding to the moving direction whose resolution has been reduced by the resolution converting step during the movement in the moving direction received by the touch input unit;
A moving speed detecting step for detecting the moving speed of the touch operation for instructing the moving direction;
Based on the moving speed of the touch operation detected by the moving speed detecting step, the size changing step for changing the size of the basic block is executed ,
The program in which the resolution conversion step, the display control step, the movement speed detection step, and the size change step are selected based on the type of touch operation based on the movement speed of the touch operation received by the touch input unit .

Images