JP6058900B2 - Information processing system, control device, image display method, and information processing program - Google Patents

Description

  The present invention relates to a technique for displaying an image on a plurality of display devices.

  Patent Document 1 describes a technique for displaying an image captured by a camera-equipped mobile phone on a large-screen television using wireless communication. According to the technique described in Patent Document 1, it is possible to view an image that can be viewed only on a small screen only with a camera-equipped mobile phone on a large screen of a television. In general, when displaying the same image, it can be said that a larger screen is easier to see than a smaller screen.

JP 2008-008917 A

However, with the technique described in Patent Document 1, the same image is simply displayed on two display devices in the same manner.
Therefore, an object of the present invention is to improve user convenience when displaying a display image based on the same image data on a plurality of display devices.

In one aspect, the present invention provides an image on a first display device, a second display device that is separate from the first display device, and the first display device and the second display device. A first display control unit that displays a display image corresponding to image data on the first display device, and a position specifying unit that specifies a position in the display image. A first magnification of the display image, and a partial image of the display image at a position specified by the position specifying unit and having a second magnification larger than the first magnification. Second display control means for selectively displaying on the second display device, wherein the first display control means causes the partial display to be displayed on the second display device by the second display control means. The position of the partial image Represents the index image further displayed on the first display device, while maintaining the display of the display image, the location was in accordance with a specific position by a specific means is displayed by moving the index image, the second When the display image is displayed on the second display device, the display control unit is configured to display the partial image when an enlargement operation for enlarging the display image and displaying the partial image is performed. Is displayed on the second display device, and the position of the partial image in the image is retained when the partial image is displayed and the image including the partial image is displayed. When the enlargement operation is performed again after holding the position, the partial image at the held position is displayed on the second display device, and the display image is displayed on the second display device. If, when the operation for scrolling the image displayed on the first display or the second display device is performed by the user, back to the predetermined initial position the held the position information Provide a processing system.

The second display control means may scroll the image displayed on the second display device in accordance with the position specified by the position specifying means.
In this way, the display image can be scrolled while being enlarged.

Further, the information processing system includes a motion detection unit that detects a motion of the second display device, and the position specifying unit specifies the position of the partial image based on the motion detected by the motion detection unit. May be.
If it does in this way, the position which expands a display picture can be changed by moving the 2nd display.

In addition, the information processing system includes a grip detection unit that detects that the user is gripping the second display device, and the position specifying unit detects the grip by the user by the grip detection unit. If so, the position of the partial image may be specified based on the motion detected by the motion detection means.
In this way, the display position of the partial image can be prevented from moving due to an unintended movement of the second display device.

The first display control means may display an image other than the image displayed in the display area when the index image reaches the boundary of the display area of the first display device. Specifically, when the image displayed in the display area is scrollable, the first display control means causes the image to be displayed by scrolling the image. Alternatively, the first display control means may display an image of the next page when the image displayed in the display area is an image of content composed of a plurality of pages.
In this way, both the display image displayed on the first display device and the partial image displayed on the second display device can be changed.

The second display control means reduces the image data and uses the partial image when the display image is displayed on the second display device at the first magnification. When displaying on the second display device at a magnification, the same image data as the image data used when the display image is displayed by the first display control means may be used.
In this way, since it is not necessary to reduce the image data when displaying the image at the second magnification, the display at the second magnification can be performed by a simpler process than the display at the first magnification. Can do.

The second display control means displays an operation object for performing an operation related to the display image when displaying the display image, and does not display the operation object when displaying the partial image. You may do it.
In this way, the partial image can be displayed using a wider range of the display area of the second display device.

Before Stories second display control means, when the partial image is displayed, respectively to display a plurality of operation objects corresponding to each operation related to the display image, wherein the control device has been said display You may provide the object selection means which receives designation | designated in any one of several operation objects from a user .
In this way, selectable objects can be narrowed down.

In another aspect of the present invention, a first display device, a second display device separate from the first display device, and a display image corresponding to image data are displayed on the first display device. A first display control means; a position specifying means for specifying a position in the display image; the display image at a first magnification; and a partial image at a position specified by the position specifying means in the display image. Second display control means for selectively displaying a partial image having a second magnification larger than the first magnification on the second display device, wherein the first display control means comprises: When the partial image is displayed on the second display device by the second display control means, an index image representing the position of the partial image is further displayed on the first display device, and the display While maintaining the image display, It is displayed by moving the index image according to the specific position by the specifying means, the second display control means, in a case where the display image is displayed on the second display device, the display image When an enlargement operation for enlarging and displaying the partial image is performed, the partial image is displayed on the second display device, and the image including the partial image is displayed from the state where the partial image is displayed. When the state is displayed, the position of the partial image in the image is held, and when the enlargement operation is performed again after holding the position, the partial image at the held position is When the display image is displayed on the second display device and the display image is displayed on the second display device, the image displayed on the first display device or the second display device by the user is scrolled. When the operation for causing is performed back to the predetermined initial position the held the position, an information processing system.
In still another aspect, the present invention provides an image on the first display device, the second display device separate from the first display device, the first display device, and the second display device. A first display control means for displaying a display image according to image data on the first display device, and the display image at a first magnification, Second display control means for selectively displaying on the second display device a partial image that is a part of the display image and that has a second magnification larger than the first magnification. The second display control means includes an image displayed on the first display device or the second display device by a user when the display image is displayed on the second display device. When the operation for scrolling is performed, the held position is Beforehand returned to determined initial position, an information processing system.
In another aspect, the present invention provides a control device configuring the information processing system described above, a program for realizing the control device, and an image display method realized by the information processing system.

  ADVANTAGE OF THE INVENTION According to this invention, when displaying the display image based on the same image data on a some display apparatus, it is possible to improve a user's convenience.

Diagram showing the configuration of the display system Diagram showing the external configuration of the controller The figure which illustrates a mode that a user holds a controller Block diagram showing the hardware configuration of the controller Block diagram showing the hardware configuration of the main unit Block diagram showing the main functional configuration of the main unit The figure which illustrates the display mode of the image in each operation mode A flowchart showing processing executed by the main device The figure which shows the example of a display of the image in a controller Flow chart showing interrupt processing including enlarged display processing The figure which shows the example of a display of the image in the case of quick zoom A flowchart showing interrupt processing including scroll display processing Flowchart showing scroll processing included in scroll display processing The figure which illustrates transition of display position information The figure which illustrates transition of display position information A flowchart showing processing executed by the main device Diagram showing screen transition of monitor The figure which illustrates the operation object and its selection candidate

[Embodiment]
FIG. 1 is a diagram showing a configuration of a display system 10 according to an embodiment of the present invention. The display system 10 is an information processing system for displaying various images according to user operations. The image displayed on the display system 10 is, for example, an image of a game or a web page.

  The display system 10 includes a monitor 100, a controller 200, and a main device 300. However, the display system 10 may include a controller other than the controller 200 or may include a plurality of controllers 200. Further, the display system 10 can be used without using the monitor 100.

  The monitor 100 is a device that displays an image, and is, for example, a television broadcast receiver. Here, the monitor 100 is a stationary display device. However, the monitor 100 does not necessarily need a function of receiving a television broadcast, and may be a display device for a personal computer. Here, it is assumed that the display area 101 of the monitor 100 is larger than the display area 241 of the controller 200. Note that the display area 101 of the monitor 100 and the display area 241 of the controller 200 may not have the same aspect ratio.

  The controller 200 is a terminal for displaying an image and a terminal for a user to carry out various operations while holding the image. Here, the controller 200 is a portable display device that has a display area 241 and is operated by being held by a user.

  The main device 300 is a control device that controls the operations of the monitor 100 and the controller 200. Therefore, the main device 300 is connected to the monitor 100 and the controller 200 by wire or wirelessly. Here, the main body apparatus 300 performs wireless communication with the controller 200 and performs wired communication with the monitor 100. However, it is also possible to perform communication in other modes.

  FIG. 2 is a diagram illustrating an external configuration of the controller 200, and illustrates a surface on which the display area 241 is provided and a surface on the opposite side. For convenience of explanation, in the following, the surface on which the display area 241 is provided is referred to as “front surface”, and the opposite surface is referred to as “rear surface”. Here, the front is a surface facing the user during operation. In the following, the surfaces other than the front surface and the back surface of the controller 200 are collectively referred to as “side surfaces”.

  In front of the controller 200, an A button 261A, a B button 261B, an X button 261X, a Y button 261Y, and a cross button 261D are provided in addition to the display area 241. Further, an L button 261L and an R button 261R are provided on the side surface of the controller 200. Furthermore, a ZL button 261ZL and a ZR button 261ZR are provided on the back of the controller 200. Hereinafter, these buttons are collectively referred to as “button group 261”.

  The button group 261 is a hardware key that can be pressed. Here, the hardware key refers to a key that exists at a predetermined position of the controller 200, and is also referred to as a physical key. The button group 261 generates operation information indicating the pressed state of each button (that is, whether or not it is pressed).

  Further, a slide pad 262 is provided on the front surface of the controller 200 in addition to the buttons constituting the button group 261. The slide pad 262 generates operation information indicating the strength and direction of the force applied by the user with a finger.

  FIG. 3 is a diagram illustrating a state in which the user holds the controller 200 with both hands. When the user holds the controller 200 in this manner, the user can press the ZL button 261ZL with the left index finger (indicator) and the ZR button 261ZR with the right index finger. When the ZL button 261ZL and the ZR button 261ZR are pressed with both hands, the user can hold the controller 200 more securely than when the ZL button 261ZL and the ZR button 261ZR are not pressed, and the user can perform various operations on the front side. However, the controller 200 is less likely to move or wobble. The effect of reliably grasping the controller 200 can also be obtained by pressing the L button 261L and the R button 261R.

  Note that the way of holding the controller 200 is not limited to the example of FIG. For example, the user can attach an index finger near the L button 261L and the R button 261R and press the ZL button 261ZL and the ZR button 261ZR with the middle finger. In addition, the user may hold the controller 200 vertically rather than horizontally.

  FIG. 4 is a block diagram illustrating a hardware configuration of the controller 200. The controller 200 includes a control unit 210, an auxiliary storage unit 220, a communication unit 230, a display unit 240, a touch screen unit 250, an operation unit 260, and a motion detection unit 270.

  The control unit 210 is means for controlling the operation of each unit of the controller 200. The control unit 210 includes an arithmetic processing unit such as a CPU (Central Processing Unit), a memory corresponding to a main storage device, an input / output interface for exchanging information with each unit of the controller 200, and the like by executing a program. Display and data transmission / reception with the main device 300 are controlled. In addition, the control unit 210 includes a codec that compresses image data to be transmitted to the main device 300 and expands image data received from the main device 300. The method of compression / decompression processing by this codec is not particularly limited. H.264.

The auxiliary storage unit 220 is a unit that stores data used by the control unit 210. The auxiliary storage unit 220 is, for example, a flash memory. The auxiliary storage unit 220 can store data such as bookmarks to be described later.
The communication unit 230 is means for communicating with the main device 300. The communication unit 230 includes an antenna for communicating with the main body device 300 by wireless communication.

  The display unit 240 is a means for displaying an image. The display unit 240 includes a display panel in which pixels are configured by a liquid crystal element or an organic EL (electroluminescence) element, and a drive circuit that drives the display panel, and displays an image according to image data supplied from the control unit 210. Displayed in the display area 241.

  The touch screen unit 250 is a unit that receives a user operation, and is a unit that generates and supplies coordinate information representing a position on the display area 241. The touch screen unit 250 includes a sensor provided so as to overlap the display area 241 and a control circuit that generates coordinate information representing a position detected by the sensor and supplies the coordinate information to the control unit 210. The detection method of the position of the touch screen unit 250 may be a resistance film method or another method such as a capacitance method.

  The touch screen unit 250 realizes a software key in cooperation with the display unit 240. Here, the software key refers to a key realized by software processing on the display area 241. Unlike a hardware key, a software key is a key that can be changed in position and switched between display and non-display.

  The operation unit 260 is another means for receiving a user operation. The operation unit 260 includes the above-described button group 261 and the slide pad 262, and supplies operation information corresponding to a user operation to the control unit 210.

  The motion detection unit 270 is a means for detecting the motion of the controller 200. The motion detection unit 270 includes a magnetic sensor 271, an acceleration sensor 272, and a gyro sensor 273, generates motion information representing the motion of the controller 200, and supplies this to the control unit 210. The motion information represents a change in geomagnetism (that is, orientation) detected by the magnetic sensor 271, a change in acceleration detected by the acceleration sensor 272, and a change in angle or angular velocity (that is, inclination) detected by the gyro sensor 273. Note that the motion detection unit 270 may be configured to include at least one of these without including the magnetic sensor 271, the acceleration sensor 272, and the gyro sensor 273.

  The controller 200 is not moved by itself but is moved by the user shaking or tilting. Therefore, it can be said that the motion detection unit 270 detects the user's motion (ie, operation) by detecting the motion of the controller 200. Therefore, here, the motion information generated by the motion detection unit 270 is included in the operation information.

  FIG. 5 is a block diagram illustrating a hardware configuration of main device 300. The main device 300 includes a control unit 310, an auxiliary storage unit 320, a disk drive unit 330, a network communication unit 340, a terminal communication unit 350, and an AV (Audio and Visual) interface unit 360.

  The control unit 310 is a means for controlling the operation of each unit of the main device 300, and corresponds to the “computer” according to the present invention. The control unit 210 is a CPU, a processing unit such as a GPU (Graphics Processing Unit), a DSP (Digital Signal Processor), a memory corresponding to a main storage device or a VRAM (Video Random Access Memory), and each unit and information of the main unit 300. An input / output interface for exchange is provided, and generation of image data to be transmitted to the monitor 100 and the controller 200 is controlled by executing a program. Programs that can be executed by the control unit 310 include a game program to be described later and a browser program for browsing web pages. The control unit 310 includes a codec that compresses image data to be transmitted to the monitor 100 and the controller 200 and decompresses image data received from the controller 200.

  The auxiliary storage unit 320 is a unit that stores data used by the control unit 310. The auxiliary storage unit 320 is, for example, a flash memory or a hard disk. The auxiliary storage unit 320 can store programs executed by the control unit 310 and data acquired via the network communication unit 340 and the terminal communication unit 350.

  The disk drive unit 330 is means for reading data stored on an optical disk (optical recording medium). For example, data necessary for executing a game such as a game program is recorded on the optical disc.

  The network communication unit 340 is means for communicating with a network such as the Internet. Communication by the network communication unit 340 may be either wired or wireless. The network communication unit 340 transmits and receives data from an external server device in accordance with instructions from the control unit 310.

  The terminal communication unit 350 is a means for communicating with the controller 200. When a different controller different from the controller 200 is used, the terminal communication unit 350 may communicate with the other controller. For the wireless communication performed by the terminal communication unit 350, any communication method such as Wi-Fi (registered trademark), Bluetooth (registered trademark), or infrared communication can be used.

  The AV interface unit 360 is means for supplying image data and audio data to the monitor 100. The AV interface unit 360 includes one or more interfaces such as HDMI (High-Definition Multimedia Interface: registered trademark) terminals.

  FIG. 6 is a block diagram (functional block diagram) showing the main functional configuration of the main device 300. The main body apparatus 300 includes a first display control unit 311, a second display control unit 312, an information acquisition unit 313, an object selection unit 314, a grip detection as a unit for realizing display of an image by the monitor 100 and the controller 200. A means 315, a position specifying means 316, and an image generating means 317; These means are realized by the control unit 310 of the main device 300 executing one or a plurality of programs, that is, by software processing. In the following description, the first display control unit 311 and the second display control unit 312 are collectively referred to as “display control unit 318”. The display control means 318 is a means for controlling image display.

  The first display control unit 311 is a unit that controls display of an image on the monitor 100. The first display control unit 311 displays an image such as a web page, and enlarges or scrolls the image as necessary. Here, scrolling refers to a display mode in which an image that cannot be entirely displayed in the display area is moved in a predetermined direction, and a portion of the image that has not been displayed so far is visualized. In the present embodiment, the scroll does not only indicate the movement of the image in the vertical direction (vertical direction) or the horizontal direction (horizontal direction), but may include the movement of the image in an oblique direction. Further, the first display control means 311 further has a function of causing the monitor 100 to display a frame image (index image) described later.

  The second display control unit 312 is a unit that controls display of an image by the controller 200. Similar to the first display control means 311, the second display control means 312 displays an image such as a web page, and enlarges or scrolls it as necessary. The second display control means 312 changes the magnification of the image when an operation for enlarging and displaying the image (hereinafter referred to as “enlargement operation”) is performed. That is, the second display control unit 312 selectively executes control for displaying an image at a predetermined magnification and control for displaying a part of the image at a magnification larger than the predetermined magnification. The second display control unit 312 may cause the controller 200 to display an image different from the image displayed on the monitor 100 by the first display control unit 311, but cooperates with the first display control unit 311. Then, a predetermined relationship may be given to the image displayed on the monitor 100 and the image displayed on the controller 200.

  The information acquisition unit 313 is a unit that acquires information. The information acquired by the information acquisition unit 313 includes operation information related to user operations. The operation information is information transmitted from the controller 200 in response to a user operation. The operation information may include the coordinate information supplied by the touch screen unit 250 and the motion information supplied by the motion detection unit 270, in addition to indicating the pressed state of the button group 261.

  The object selection unit 314 is a unit that selects an object included in the image displayed in the display area in accordance with a user operation. Here, an object refers to an object to be operated, and corresponds to an image such as an icon, a widget (also referred to as a control) such as a button, scroll bar, or text box in a GUI (Graphical User Interface). In addition, characters may function as selectable objects. For example, when the image displayed in the display area is a web page, a character string that functions as a hyperlink corresponds to the object. The object selection unit 314 selects an object based on the operation information acquired by the information acquisition unit 313. Note that the object selection unit 314 can select an object regardless of whether the controller 200 is displaying an enlarged image or not.

  Further, the object selection unit 314 makes the object selectable when the user performs a predetermined operation (for example, pressing a button) on the object in the selectable state after making the object selectable. You can choose. Here, the selectable object refers to an object having an input focus.

  Note that the display control unit 318 (that is, the first display control unit 311 and the second display control unit 312) depends on the operation information acquired by the information acquisition unit 313 and the object selected by the object selection unit 314. It is possible to display different images. For example, when the first display control unit 311 and the second display control unit 312 are displaying a certain web page, when an object indicating a predetermined hyperlink included in the web page is selected, the first display control unit 311 and the second display control unit 312 Another web page indicated by the object can be displayed on the monitor 100 and the controller 200.

  The grip detection unit 315 is a unit that detects that the user is gripping the controller 200. The grip detection unit 315 detects that the user is gripping the controller 200 in a predetermined manner using predetermined operation information. In the present embodiment, when the grip detection unit 315 detects that both the ZL button 261ZL and the ZR button 261ZR are pressed, it is determined that the user is gripping the controller 200 with both hands as shown in FIG. To detect.

  Note that the grip detection unit 315 may detect that the user is gripping the controller 200 based on another operation. For example, instead of pressing the ZL button 261ZL and the ZR button 261ZR, the grip detection unit 315 may detect the gripping of the user based on the pressing of the L button 261L and the R button 261R. The user's grip may be detected when all the buttons are pressed. In addition, the detection by the grip detection unit 315 may detect the grip of the user based on other sensors (such as a touch sensor) instead of pressing the hardware key.

  The position specifying unit 316 is a unit that specifies a predetermined position in the image displayed on the controller 200. Here, the predetermined position refers to a position to be enlarged and displayed among images displayed on the controller 200. In the present embodiment, the position specifying unit 316 can specify the position based on operation information from the user. The position specifying unit 316 can also specify a position by referring to display position information described later.

  The image generation means 317 is means for interpreting web page data (hereinafter referred to as “content”) described in a markup language such as HTML (HyperText Markup Language) and generating bitmap data representing the web page. is there. The content here includes, in addition to the data of the web page itself described in the markup language, the accompanying style sheet, image data, script, and the like.

  The image generation means 317 acquires the content via the network communication unit 340, determines an image to be displayed by arranging characters and images based on the content, and adjusting the appearance of the characters. Bitmap data that represents the processed image as a bitmap image is generated. That is, the image generation means 317 has main functions (user agent, parser, renderer) as a web browser. The image generation unit 317 records bitmap data in the VRAM. When displaying a web page, the first display control unit 311 and the second display control unit 312 read the bitmap data generated by the image generation unit 317 in this way from the VRAM and display the image. .

  Note that the main device 300 does not have to include all of the units illustrated in FIG. For example, if the image to be displayed is not a web page image, the main body device 300 does not need to have the image generation unit 317 and may not have the grip detection unit 315 as described later. is there. Moreover, the main body apparatus 300 may implement | achieve the means shown in FIG. 6 by a single program, and may be implement | achieved by a some program. For example, the image generation unit 317 may be realized by a program (browser program) different from other units.

  The configuration of the display system 10 is as described above. Based on this configuration, the main device 300 displays an image on at least one of the monitor 100 and the controller 200. The main device 300 may display an image on only one of the controller 200 and the monitor 100 or display an image on both the monitor 100 and the controller 200 in accordance with a user operation and the type of image to be displayed. it can. When displaying images on both the monitor 100 and the controller 200, the main device 300 can display the same image on both sides or display different images on each other.

  For example, in the case of playing a game, when there are a plurality of users such as family members and friends, a specific user operates while looking at the controller 200, and other users check the development of the game on the monitor 100. Is assumed. In this case, if there are a plurality of controllers 200 or a controller other than the controller 200, a plurality of users can participate in the game.

  Further, the user can not only play a game but also browse a web page using the display system 10. Alternatively, the user can browse captured images (moving images or still images) and electronic documents. At this time, the user can display an image on both the monitor 100 and the controller 200, or can display an image only on one of the monitor 100 and the controller 200.

  In the present embodiment, the display system 10 can display images based on the same content on both the monitor 100 and the controller 200. At this time, the display system 10 has an operation mode in which the entire image displayed on the monitor 100 is displayed on the controller 200, and an operation mode in which a part of the image displayed on the monitor 100 is enlarged and displayed on the controller 200. It is possible to operate in the following two operation modes. In the following, the former operation mode is referred to as “same size mode”, and the latter operation mode is referred to as “enlargement mode”. Further, there are a plurality of modes of enlargement in the enlargement mode as will be described later.

  FIG. 7 is a diagram illustrating an image display mode in each operation mode. FIG. 7A shows a display example in the normal magnification mode, and FIG. 7B shows a display example in the enlargement mode. In the same magnification mode, an image Im12 substantially the same as the image Im11 displayed in the display area 101 of the monitor 100 is displayed in the display area 241 of the controller 200. These images may have slightly different displayed parts or layouts due to differences in aspect ratio between the display area 241 and the display area 101. In the same magnification mode, the user can basically confirm the same contents regardless of which of the display area 241 and the display area 101 is viewed. However, since the display area 241 and the display area 101 have different sizes, the image Im11 is larger than the image Im12.

  On the other hand, when the operation mode is changed from the normal magnification mode to the enlargement mode, an image Im12a that is an image obtained by enlarging a part of the image Im12 displayed in the normal magnification mode is displayed in the display area 241 of the controller 200. Become so. In the enlargement mode, a frame image Im13 representing the position of the image Im12a is displayed in the display area 101 of the monitor 100 in addition to the image Im11. The frame image Im13 corresponds to an example of the “index image” according to the present invention. Note that the index image is not limited to the frame image Im13, but is an image in which the area displayed on the controller 200 is indicated by one or a plurality of points, or an image in which the color of the image in the area is changed from another area. It is also possible to use (for example, an image that reversely displays or blinks in the area).

  In the enlargement mode, the user can check a part of the image displayed on the monitor 100 with the controller 200 at hand. That is, the user can check a specific part of the image in more detail with the controller 200 as needed while checking the entire image (or a wide part) on the monitor 100 from a bird's-eye view. In addition, since the controller 200 includes various operation means, the user can easily perform an appropriate operation while checking the image in detail with the controller 200 at hand.

  A general usage form of the display system 10 is that a user uses the controller 200 while being held away from the monitor 100 to some extent (several meters or more). That is, the controller 200 is usually closer to the user than the monitor 100. Therefore, the controller 200 is a display device that is more suitable for confirming the details of the image than the monitor 100, and is also a display device that is suitable for performing an operation.

  The following description shows an operation in browsing a web page as an example of display in the display system 10. Here, for the sake of convenience of explanation, there is a part where the display control for the monitor 100 and the display control for the controller 200 are described separately, but actually, the display control for both is performed in parallel.

  FIG. 8 is a flowchart illustrating basic processing executed when main device 300 causes controller 200 to display a web page image. In this process, the control unit 310 of the main device 300 first acquires page data in accordance with a predetermined operation by the user (step S11). For example, when the user presses a predetermined key, the control unit 310 reads a URL (Uniform Resource Locator) of a preset web page, and acquires the content indicated by the URL via the network communication unit 340.

  When acquiring the page data, the controller 310 generates bitmap data based on the page data (step S12). The control unit 310 executes processing such as rendering to generate bitmap data and temporarily records it in the VRAM.

Next, the control unit 310 performs predetermined image processing on the bitmap data (step S13). Here, the predetermined image processing refers to image processing for displaying an image corresponding to the size of the display area 241 of the controller 200. In the present embodiment, the control unit 310 performs a thinning process for thinning out the pixels constituting the bitmap data and reducing the number of pixels (the number of pixels). This thinning process may be performed using any known thinning process for reducing bitmap data. For example, the control unit 310 reduces the number of pixels in the vertical direction and the horizontal direction to 1/2 (1 / n), and executes the thinning process so that the total number of pixels becomes 1/4 (1 / n ² ). To do.

  Next, the control unit 310 generates image data based on the bitmap data after the thinning process, and transmits this to the controller 200 via the terminal communication unit 350 (step S14). Image data is data including an image obtained by compressing bitmap data by a predetermined compression method. The image data can also include an image corresponding to an operation object described later. When receiving the image data, the control unit 210 of the controller 200 displays the image of the web page in the display area 241.

  FIG. 9 is a diagram illustrating a display example of an image in the controller 200. In this example, the controller 200 displays menu images Im22 and Im23 in addition to the web page image Im21. The menu images Im22 and Im23 are images that display, for example, the URL of the web page being displayed or a text box for searching by a search engine. The menu images Im22 and Im23 include operation objects that are objects that can be selected by the user through an operation (touch operation) on the display area 241. The operation object may include, for example, an icon for displaying a bookmark (one or more favorite URLs registered in advance), an icon for returning a web page to be displayed to a previously viewed page, and the like. In the embodiment, at least a reduction icon Ic1 that is an icon for reducing the image Im21 of the web page displayed in the display area 241 and an enlargement icon Ic2 that is an icon for enlarging the image Im21 are included.

Note that the number and arrangement of the operation objects are not particularly limited, and may be arranged on the left and right instead of the top and bottom like the menu images Im22 and Im23 in FIG. May be. Further, the display of the operation object is not essential.
In the following, an image displayed as shown in FIG. 8 (that is, an image before enlargement) is referred to as an “actual size image” for the purpose of distinguishing from an enlarged image described later. The same-size image is an example of the “display image” in the present invention, and is an image displayed at “first magnification”.

  The main device 300 displays the image on the controller 200 in this way and also displays the image on the monitor 100. Based on the same content as the image displayed on the controller 200, the main device 300 generates image data to be supplied to the monitor 100 by the same processing as the processing shown in FIG. However, the main device 300 generates the image data to be supplied to the monitor 100 without executing the thinning process (step S13). By doing so, it is possible to easily obtain an image having a larger size (or higher resolution) than the image displayed on the controller 200.

  Note that the image displayed on the monitor 100 is only the image Im21 shown in FIG. 9, and the menu images Im22 and Im23 may not be displayed. This is because a user operation cannot be accepted depending on the display area 101 of the monitor 100. However, the menu images Im22 and Im23 may be displayed in the display area 101.

  When the main device 300 displays an image on the monitor 100 and the controller 200 in this way, the display state shown in FIG. 7A is realized. At this time, the user can enlarge and display a part of the normal-size image by operating the controller 200 on which the normal-size image is displayed. In the present embodiment, there are two modes for enlarging and displaying an image. The first mode is a mode in which when a predetermined key is pressed, the image is enlarged and displayed at a specific magnification only while the key is pressed, and when the key is released, the image is returned to the same size image. This aspect is realized by switching whether to perform the thinning process. On the other hand, a 2nd aspect is an aspect which expands (or reduces) in steps according to the frequency | count of pressing a predetermined key. In the second aspect, the magnification can be set more finely than in the first aspect.

  Hereinafter, the enlargement or reduction of the first aspect is referred to as “quick zoom”, and the enlargement or reduction of the second aspect is referred to as “step zoom”. In the present embodiment, the quick zoom is performed by pressing the Y button 261Y, and the step zoom is performed by pressing either the reduction icon Ic1 or the enlargement icon Ic2. Note that these keys (software key or hardware key) are merely examples, and the key for enlarging or reducing may be another key. For example, the quick zoom may be performed by pressing the L button 261L or the R button 261R, or may be performed by pressing a predetermined icon (that is, a software key) provided in the display area 241. .

  FIG. 10 is a flowchart showing an interrupt process including an enlarged display process. The process shown in FIG. 10 is an interrupt process that is executed when a user operation is performed (that is, when operation information is acquired) in a state where an equal-size image is displayed. Note that the user's operation includes operations other than the enlargement operation for enlarging and displaying the same-size image. However, here, the description will focus on the processing when the enlargement operation is performed. A description of the processing is omitted as appropriate.

  When acquiring the operation information, the control unit 310 of the main device 300 specifies the operation represented by the operation information (Step S21). Then, control unit 310 determines whether or not the identified operation is an enlargement operation (step S22). If the identified operation is not an enlargement operation, control unit 310 executes a process corresponding to the operation (step S27). The process in step S27 is, for example, a process of switching the same-size image to be displayed in units of pages.

  In addition, when the identified operation is an enlargement operation, control unit 310 further varies the processing according to the operation. Specifically, control unit 310 determines whether or not the enlargement operation is an operation for performing quick zoom (that is, Y button 261Y) (step S23), and executes processing according to the determination result.

  When the quick zoom operation is performed, the control unit 310 stores bitmap data before thinning processing (that is, bitmap data that has not been reduced) stored in the VRAM, and display position information that indicates a position to be enlarged and displayed. (Step S24), and based on these, image data is generated and transmitted (step S25). The process of step S25 is performed in the same manner as the process of step S14, except that display position information is used.

  The display position information is information indicating which part of the same-size image is enlarged and displayed, and its initial value indicates a predetermined position (hereinafter referred to as “initial position”). Here, the initial position is the center of the same-size image, but may be the end of the same-size image (for example, the upper left end). The display position information is changed by scrolling the image, as will be described in detail later. The display position information is represented by, for example, the coordinates of each vertex of a quadrangle corresponding to the display area 241, but may be represented by the coordinates of a specific vertex representing each vertex.

  On the other hand, when the step zoom operation is performed, the control unit 310 regenerates the bitmap data according to the magnification to be enlarged (step S26). That is, at this time, the control unit 310 again executes processing such as rendering based on the page data. Then, the control unit 310 generates and transmits image data based on the bitmap data generated again in this way (step S25).

  FIG. 11 is a diagram illustrating a display example of an image in the case of the quick zoom, and illustrates an enlarged image of the image Im21 illustrated in FIG. Hereinafter, an image Im21a obtained by enlarging a part of the same-size image displayed at this time is referred to as an “enlarged image”. The enlarged image is an example of a “partial image” according to the present invention, and is an image displayed at “second magnification”. In the present embodiment, the enlarged image is displayed with a size four times that of the same size image. In addition, the rectangle shown with the broken line in FIG. 11 is a rectangle of the size of the display area 241 shown for reference.

  When displaying an enlarged image, as shown in FIG. 11, it is possible not to display the menu images Im22 and Im23 shown in FIG. 9 (which may of course be displayed). When the operation object is hidden in this way, the user can confirm the enlarged image without being obstructed by the operation object. The case of enlarging the image is mainly when it is desired to confirm the image in more detail. Therefore, in such a case, it may be desirable that no image other than the desired image (display image) is displayed. In addition, displaying an enlarged image without displaying the operation object can increase the amount of information that can be confirmed on the screen, compared with the case of displaying the operation object, which can improve user convenience. is there. In particular, in the case of the present embodiment, since the key for performing the quick zoom is not a software key but a hardware key, an enlarged image can be displayed without displaying an operation object at all.

  The display mode in the case of step zoom is the same as that in the case of quick zoom. However, when the step zoom is performed, the reduction icon Ic1 and the enlargement icon Ic2 may be displayed. Further, the magnification in the case of step zoom is different from the magnification in the case of quick zoom (4 times that of the same-size image), for example, smaller than the magnification in the case of quick zoom (1.2 times, 1.5 times, 2 times etc.) is desirable.

  By displaying the enlarged image in this way, the user can check the enlarged image in two ways. When the quick zoom is used, the same data as the bitmap data used when the display image is displayed on the monitor 100 is used (that is, diverted), so that the processing for generating bitmap data such as rendering is executed again. This is unnecessary, and it is possible to reduce the time required for displaying an image and the load of hardware resources, compared with the case of using step zoom. On the other hand, when step zoom is used, it is possible to display an enlarged image with a magnification that does not depend on the number of pixels of the same size image.

  Further, in the present embodiment, since it is possible to display an enlarged image without pressing the Y button 261Y multiple times or long pressing, compared with the case where these operations are required for enlarged display. The time required to start displaying the enlarged image is shortened. Therefore, according to the quick zoom of the present embodiment, it is possible to realize a quick display of an enlarged image, coupled with the point that processing such as rendering is not required. In addition, by using both the quick zoom and the step zoom, the user can use the quick display of the enlarged image and the display at a finer magnification as necessary.

  FIG. 12 is a flowchart showing interrupt processing including scroll display processing. The process shown in FIG. 12 is an interrupt process that is executed when a user operation is performed and operation information is acquired in a state in which a normal-size image or an enlarged image is displayed. This shows processing when an operation for scrolling an image (hereinafter referred to as “scrolling operation”) is performed. The process shown in FIG. 12 may be incorporated into the process shown in FIG. 10 and executed in parallel.

  In the present embodiment, it is assumed that the scroll operation can be realized by the following three operations. That is, the first operation is a touch operation on the display area 241, the second operation is an operation on the slide pad 262, and the third operation is an operation by moving the controller 200. The third operation is, for example, that when the user moves the controller 200 to the left, the image displayed in the display area 241 moves to the right, and the left image that has not been seen until then becomes visible. To be done. Note that the third operation may be such that the image is scrolled by the tilt of the controller 200, or the scroll amount of the image is changed by the speed or acceleration given to the controller 200.

  However, the scroll operation does not necessarily need to be three types, and may be only one or two of these. Further, when there are a plurality of scroll operations, it is preferable that a predetermined priority order indicating which operation is to be prioritized is determined in advance so as not to cause an operation conflict. In the present embodiment, the priority of the operation information of the touch operation on the display area 241 is the highest (priority is highest), and the priority of the motion information is the lowest. In this case, when the control unit 310 acquires both the operation information and the motion information of the touch operation, the control unit 310 preferentially processes the former. For example, if the touch operation information indicates leftward scrolling and the motion information indicates rightward scrolling, the control unit 310 determines that this is a leftward scrolling operation. to decide.

  When acquiring the operation information, the control unit 310 of the main device 300 identifies the operation represented by the operation information (step S31). This process is performed similarly to the process of step S21 shown in FIG. Next, the control unit 310 determines whether or not the identified operation is a scroll operation (step S32). At this time, control unit 310 determines whether any of the first operation to the third operation described above has been performed.

  When an operation other than the scroll operation is performed, the control unit 310 performs a process according to the operation (step S36). The process in step S37 may include, for example, a process when an enlargement operation is performed (see FIG. 10), or may include other processes, but is not directly related to screen scrolling. Therefore, the description thereof is omitted.

  In addition, when the identified operation is a scroll operation, control unit 310 determines the type of the scroll operation. Specifically, control unit 310 determines whether or not the acquired operation information includes motion information generated by motion detection unit 270 (step S33). When the operation information includes motion information, the control unit 310 further determines whether the operation information includes operation information indicating that the ZL button 261ZL and the ZR button 261ZR are pressed (step S34). ).

  Note that the control unit 310 determines whether or not the amount of movement (movement amount, inclination amount) represented by the acquired motion information is a certain amount or more, instead of the processing of step S34 or together with the processing of step S34. When this is a certain amount or more, the process may proceed to step S35. That is, pressing of the ZL button 261ZL and the ZR button 261ZR is not essential. In other words, the grip detection by the grip detection means 315 is not essential.

  The control unit 310 performs scroll processing when the operation information does not include motion information and when the operation information includes motion information and the ZL button 261ZL and the ZR button 261ZR are pressed (step S35). On the other hand, if the operation information includes motion information, but the ZL button 261ZL and the ZR button 261ZR are not pressed, the control unit 310 does not execute the scroll process and ignores the motion information. That is, in the present embodiment, the scroll operation based on the motion information is validated when the ZL button 261ZL and the ZR button 261ZR are pressed, and otherwise invalid.

  FIG. 13 is a flowchart showing in detail the scroll process in step S35. In this scroll process, first, the control unit 310 determines whether or not quick zoom is performed by the user (step S351), and executes different processes depending on the determination result. Control unit 310 makes this determination by determining whether or not Y button 261Y is pressed.

  If the quick zoom is being performed, the control unit 310 scrolls and displays the enlarged image displayed at that time according to the scroll operation of the user (step S352). Then, control unit 310 updates the recorded display position information in accordance with the movement of the enlarged image by scrolling (step S353). Specifically, control unit 310 records the position of the enlarged image displayed at this time in the same size image as display position information.

  The display position information recorded in step S353 is read in step S24 described above when the quick zoom operation is performed again. In this way, the control unit 310 maintains the display position of the enlarged image when the enlargement operation is not performed (that is, when the quick zoom operation ends), and the scroll operation is performed after the display position is held. When the enlargement operation is performed again without being performed, the enlarged image at the previous display position can be displayed.

  On the other hand, if the quick zoom is not being performed, the control unit 310 scrolls and displays the same-size image displayed at that time according to the user's scroll operation (step S354). When the display of the same-size image itself changes as described above, the control unit 310 changes the display position information so as to return the position of the enlarged image to a predetermined initial position (step S355). The initial position is, for example, the central portion of the same-size image displayed at that time. Therefore, the initial position changes according to the scrolling of the normal-size image. That is, the initial position is always a constant position in relation to the same-size image displayed at that time, but can be said to be related to the entire same-size image (including a portion not displayed at that time). For example, the position is not necessarily constant. Therefore, the control unit 310 records the display position information with the coordinates in the equal-size image.

  When the control unit 310 scrolls the same-size image or the enlarged image in this way, it determines whether or not the scroll operation is finished (step S356), and repeats the processes of steps S351 to S355 until the scroll process is finished. . As is clear from the description of FIG. 13, the user can start the enlargement operation halfway or end the enlargement operation halfway in this repetition.

  14 and 15 are diagrams illustrating the transition of the display position information by such scroll display. FIG. 14 shows a transition of display position information when a horizontal scroll operation is performed during display of an enlarged image (ie, during execution of quick zoom), and FIG. 15 shows during display of a normal-size image. The figure shows transition of display position information when a vertical scroll operation is performed. In the example of FIG. 15, the web page is a vertically long page, and only a part of the web page is displayed in the display area 241.

  In FIG. 14, an image Im31 represents an equal-size image. In this case, it means that the image Im31 is displayed in the display area 241 before the enlargement operation is performed. The display positions Dp31 and Dp32 represent the display positions of the enlarged images before and after scrolling. For example, in the case where the enlarged image at the display position Dp31 is displayed, when the user performs a scroll operation in the left direction, the display position of the enlarged image changes from the display position Dp31 to the display position Dp32. The control unit 310 records display position information representing these display positions. That is, the control unit 310 records display position information representing the display position Dp31 before the left scroll operation, and records display position information representing the display position Dp32 after the scroll operation.

  On the other hand, in FIG. 15, the web page Wp41 represents the entire web page (one page). Here, the image Im41 represents the same size image before the scroll operation, and the image Im42 represents the same size image after the scroll operation. Here, assuming that the enlargement operation is not performed and the initial position of the display position is the center of the same-size image, the display position is the display position Dp41 in the image Im41 and the display position Dp42 in the image Im42. It is. That is, at this time, the control unit 310 changes the display position information so that only the position on the web page changes without changing the relative position in the equal-size image. In this case, when the user performs an enlargement operation before the scroll operation, an enlarged image corresponding to the display position Dp41 is displayed in the display area 241. When the user performs the enlargement operation after the scroll operation, the display area 241 An enlarged image corresponding to Dp42 is displayed.

  Since the scroll operation of this embodiment is performed by an operation different from the enlargement operation, for example, the enlargement operation is started in the middle of the scroll operation or the scroll operation is performed in the middle of the enlargement operation. It is possible to start. Thus, the user can perform the other operation when necessary without being affected by whether or not one operation is being performed.

  Further, when the scroll operation according to the present embodiment is realized by the motion information by the motion detection unit 270, the ZL button 261ZL and the ZR button 261ZR need to be pressed. That is, the ZL button 261ZL and the ZR button 261ZR function as switches that can be pressed at this time, and image scrolling is performed when this switch is in an ON state (pressed state). . As described above, when the ZL button 261ZL and the ZR button 261ZR are pressed with both hands, the user can surely hold the controller 200, so that more accurate motion information is easily obtained.

  For example, when the user allows the controller 200 to be operated with one hand, the controller 200 is likely to make an unintended movement (a movement different from the movement for the scroll operation). It becomes difficult to distinguish the movement for the scroll operation, and as a result, there is a high possibility that the image is unintentionally scrolled. On the other hand, if a rule is provided such that the ZL button 261ZL and the ZR button 261ZR must be pressed when performing a scroll operation, the user is guided to hold the controller 200 in a desirable way of holding (see FIG. 3). Therefore, it can be expected that the possibility that the main body apparatus 300 erroneously detects the scroll operation is lower than the case where such a rule is not provided. Such an effect can be expected not only by pressing the ZL button 261ZL and the ZR button 261ZR but also by pressing the L button 261L and the R button 261R.

  The image (magnified image or enlarged image) of the controller 200 is displayed as described above. At this time, the control unit 310 also changes the image displayed on the monitor 100 as necessary. If the controller 200 is displaying the same size image, the same image is also displayed on the monitor 100. That is, when the controller 200 is displaying a normal-size image, the control unit 310 causes the monitor 100 to display an image so as to follow the change in the normal-size image. For example, if a scroll operation is performed during the display of the normal-size image, the control unit 310 also scrolls the image on the monitor 100 in accordance with the scroll of the normal-size image (step S354).

  On the other hand, when the controller 200 is displaying an enlarged image, the control unit 310 makes the display mode of the monitor 100 different from the case of the same size image. More specifically, the control unit 310 controls the display of the image in a manner corresponding to the position of the enlarged image (that is, the frame image) with respect to the display image displayed on the monitor 100.

  FIG. 16 is a flowchart illustrating processing executed when the main apparatus 300 displays an image on the monitor 100 when an enlargement operation is performed. This process is a process that is repeatedly executed in parallel with the process (see FIG. 8) for causing the controller 200 to display an image when the enlargement operation is performed in the main device 300. That is, when this processing is being performed, the controller 200 displays an enlarged image.

  In this process, the control unit 310 of the main device 300 first displays a web page image (display image) and a frame image (step S41). Since the control unit 310 also performs control to display an image on the controller 200, the position of the image displayed on the controller 200 can be specified. The control unit 310 specifies the position of the frame image by specifying the position of the image displayed on the controller 200.

  Next, the control unit 310 determines whether or not a scroll operation has been performed via the controller 200 (step S42). When the scroll operation is not performed, the control unit 310 ends the process without scrolling the image. On the other hand, when the scroll operation is performed, the control unit 310 further determines whether or not the frame image has reached the boundary of the display area 101 in the direction in which the scroll operation is performed (step S43). On the other hand, if the scroll operation is not performed, the control unit 310 ends this process without changing the image to be displayed on the monitor 100.

  When the frame image has reached the boundary of the display area 101, the control unit 310 further determines whether scrolling is possible in the direction in which the scroll operation is performed (step S44). Here, if scrolling beyond that is impossible, such as at the end of a web page, the control unit 310 ends this processing without scrolling the image. On the other hand, when the scroll operation is possible, the control unit 310 scrolls the image displayed on the monitor 100 in the direction in which the scroll operation is performed, and images other than the image (that is, among the display images). The image of the portion that has not been displayed until then) is displayed (step S45).

  Further, when the frame image has not reached the boundary of the display area 101, the control unit 310 moves only the display position of the frame image without scrolling the web page image displayed on the monitor 100 ( Step S46). However, even in this case, scroll display of the image displayed on the controller 200 is performed.

  FIG. 17 is a diagram illustrating screen transition of the monitor 100. In this example, the monitor 100 displays a web page image Im51 that is vertically longer than the display area 101. In the figure, areas of the web page that are not displayed in the display area 101 are indicated by broken lines.

  In the state of FIG. 17A, the frame image Im52 is displayed in the center of the display area 101. In this state, when the user performs a scrolling operation of scrolling downward, the main body device 300 moves the display position of the frame image Im52 downward. At this time, the main device 300 scrolls the image to be displayed in the display area 241 of the controller 200 in accordance with the movement of the frame image Im52. When such a scroll operation is continuously performed, the frame image Im52 eventually reaches the boundary of the display area 101 as shown in FIG.

  As shown in FIG. 17B, when the frame image Im52 reaches the boundary of the display area 101 and the scroll operation is further performed downward, the main device 300 is displayed in the display area 101. Scrolling is started to change the image Im51 of the web page. As a result, a portion of the image Im51 that has not been seen until then is gradually displayed. After that, when the scroll operation in the downward direction is repeated until the lower end of the web page is displayed, the state shown in FIG. 17C is obtained, and no further scrolling is performed.

  According to the present embodiment, the user can also scroll the image displayed on the monitor 100 as necessary by a scroll operation for scrolling the image displayed on the controller 200. In addition, the user can confirm an image of a portion that cannot be displayed in the display area 241 of the controller 200 by confirming the display area 101 of the monitor 100, and can display the image by confirming the frame image. The positional relationship between the image displayed in the area 101 and the image displayed in the display area 241 can be grasped.

[Modification]
The above-described embodiment is an aspect of the present invention. The present invention is not limited to this embodiment, and can be implemented in other modes as shown in the following modifications. In addition, this invention can also be applied combining a some modification as needed.

(Modification 1)
In the present invention, the operation mode is not switched by performing an enlargement operation at any time during image display, and the operation mode may be set in advance before displaying an image. In this case, if “enlargement mode” is set as the operation mode in this case, the user can display an enlarged image (partial image) on the controller 100 from the beginning without performing an enlargement operation.

(Modification 2)
The controller 200 may have a configuration corresponding to the grip detection unit 315 instead of the main body device 300. In this case, the controller 200 may transmit data such as a flag indicating that gripping by the user has been detected to the main body device 300. However, when the gripping by the user is detected, the controller 200 transmits motion information. If gripping is not detected, the movement information may not be transmitted.

(Modification 3)
The display area 101 of the monitor 100 does not necessarily need to be larger than the display area 241 of the controller 200, and may be the same size or smaller than the display area 241. In addition, the display device (first display device) corresponding to the monitor 100 and the display device (second display device) corresponding to the controller 200 may be configured separately, and are connected to each other by wire. Such a configuration may be used.

(Modification 4)
The user can select an operation object displayed in the display area 241 when a normal-size image or an enlarged image is displayed in the display area 241. In other words, the main body device 300 can accept an operation for selecting an operation object both when the enlargement operation is performed and when the enlargement operation is not performed. The user may select an operation object by a touch operation on the display area 241, but can also select by another operation. For example, the controller 200 may cause the cross button 261D and the A button 261A to function as keys for selecting an operation object.

  As an operation method for selecting an operation object using the cross button 261D and the A button 261A, the following method is conceivable. For example, there is a method of switching operation object selection candidates with the cross button 261D and selecting a selection candidate with the A button 261A (ie, confirming the operation object to be selected).

FIG. 18 is a diagram exemplifying operation objects displayed in the same size image and the enlarged image, and selection candidates thereof. In the figure, it is assumed that images with alphabets A to P are selectable icons and operation objects. In this example, when the user presses the cross button 261D, any operation object becomes a selection candidate according to a predetermined rule. For example, in the illustrated example, the operation object in the upper left of the display area 241 is the first selection candidate. Thereafter, the user can move the selection candidate up, down, left, and right by pressing the cross button 261D. For example, in the state shown in FIG. 18A, when the user designates the right direction once with the cross button 261D, the selection candidate is switched from the icon “A” to the icon “B”.
On the other hand, FIG. 18B shows an enlarged image Im62 of the same-size image Im61 shown in FIG. In the case where the enlarged image Im62 is displayed, the icon “F” is the first candidate for selection.

  As described above, the case where the enlargement operation is performed and the case where the enlargement operation is not performed may differ in the initial selection candidate, and the number of selectable operation objects may also differ. Therefore, the user may be able to select a desired operation object with fewer times by performing an enlargement operation and displaying an enlarged image. For example, the minimum number of times the cross button 261D is pressed to select the icon “K” is smaller in the case of the enlarged image in FIG. 18B than in the case of the same-size image in FIG. Therefore, in such a case, it may be desirable to operate the cross button 261D after performing the enlargement operation. On the other hand, if it is desired to place importance on the listability of information or a desired operation object is not particularly determined, it may be better to operate the cross button 261D without performing the enlargement operation.

  In this case, the cross button 261D can also be used for a scroll operation. For example, in the state shown in FIG. 18B, when the up direction is indicated by the cross button 261D, the enlarged image Im62 is scrolled, the icons “J” and “K” are hidden and the icons “B” and “C” are hidden. "May be displayed.

(Modification 5)
The same-size image displayed on the controller 200 may be an image in the same area as the image Im42 displayed on the display area 101 of the monitor 100, such as an image Im41 shown in FIG. May be. For example, the same size image displayed on the controller 100 may be a partial image of the image Im42 displayed in the display area 101 of the monitor 100. In such a case, the main device 300 may display the index image (frame image) not only when the enlargement operation is performed but also when the enlargement operation is not performed.

  That is, the same-size image displayed in the display area 241 does not need to have the same magnification (that is, the same size) as the image displayed in the display area 101 of the monitor 100. In other words, “same size” of the same size image only means that the image is not enlarged when compared with the enlarged image, and does not mean the comparison with the image displayed on the monitor 100. Here, the magnification of the displayed image is based on the non-enlarged image displayed on the controller 200 here, but it is of course possible to use the image displayed on the monitor 100 as a reference.

(Modification 6)
The main device 300 may enlarge not only the image displayed on the controller 200 but also the image displayed on the monitor 100 as necessary. For example, the main device 300 may enlarge the image displayed on the monitor 100 so as to be interlocked with the image displayed on the controller 200 in accordance with the enlargement operation.

(Modification 7)
The operation for returning the position represented by the display position information to the initial position is not limited to the scroll operation. For example, even when an operation object such as a hyperlink is selected or an icon displayed on the menu images Im12 and Im13 is selected, the control unit 310 may return the position represented by the display position information to the initial position. Good.

(Modification 8)
The present invention is not limited to a form such as a main body apparatus 300, an information processing system including the main body apparatus 300 and the controller 200, and an information processing system including the monitor 100 (display system 10), and a configuration corresponding to the main body apparatus 300 and the controller 200. The present invention can also be implemented in the form of a display device integrally provided with a configuration corresponding to Alternatively, the present invention is configured such that a part or all of the control according to the present invention (that is, control by the first display control unit 311 and the second display unit 312) is executed by the monitor 100 and the controller 200. Alternatively, the display control in each display device may be executed by each device without providing a configuration corresponding to the main device 300. In addition, the display device according to the present invention may have a shape held with one hand instead of a shape held with both hands, or may be operated while placed on a desk or the like. Note that the control device according to the present invention may not have a game function.

  The present invention is not limited to the form of such a control device and information processing system, but also an image display method for displaying an enlarged image (partial image) on a display device, and information for realizing the image display method. Implementation in the form of a processing program is also possible. Furthermore, the information processing program according to the present invention can be provided in a form recorded on a recording medium such as an optical disc or a semiconductor memory, or in a form downloaded to a control device via a network such as the Internet.

DESCRIPTION OF SYMBOLS 10 ... Display system, 100 ... Monitor (1st display apparatus), 101 ... Display area, 200 ... Controller (2nd display apparatus), 210 ... Control part, 220 ... Auxiliary storage part, 230 ... Communication part, 240 ... Display unit 241 ... Display area 250 ... Touch screen unit 260 ... Operation unit 270 ... Motion detection unit 300 ... Main unit (control device) 310 ... Control unit 311 ... First display control means 312 ... Second display control means, 313 ... information acquisition means, 314 ... object selection means, 315 ... grip detection means, 316 ... position specifying means, 317 ... image generation means, 318 ... display control means, 320 ... auxiliary storage section, 330 ... Disk drive unit, 340 ... Network communication unit, 350 ... Terminal communication unit, 360 ... AV interface unit

Claims (13)

A first display device; a second display device separate from the first display device;
A control device for displaying an image on the first display device and the second display device;
The controller is
First display control means for displaying a display image according to image data on the first display device; position specifying means for specifying a position in the display image;
The display image having a first magnification, and a partial image having a second magnification larger than the first magnification, which is a partial image at the position specified by the position specifying unit in the display image, Second display control means for selectively displaying on the second display device,
The first display control means includes
When the partial image is displayed on the second display device by the second display control means, an index image representing the position of the partial image is further displayed on the first display device,
While maintaining the display of the display image, the index image is moved and displayed according to the position specified by the position specifying means ,
The second display control means includes
When the display image is displayed on the second display device, when the enlargement operation for enlarging the display image and displaying the partial image is performed, the partial image is displayed on the second display device. When the display device is displayed, and when the state of the partial image is changed to the state of displaying the image including the partial image, the position of the partial image in the image is retained,
When the enlargement operation is performed again after holding the position, the partial image at the held position is displayed on the second display device,
When the display image is displayed on the second display device, the user performs an operation for scrolling the image displayed on the first display device or the second display device. Returning the held position to a predetermined initial position;
Information processing system. The information processing system according to claim 1, wherein the second display control means scrolls an image displayed on the second display device in accordance with the position specified by the position specifying means. A motion detecting means for detecting the motion of the second display device;
The information processing system according to claim 1 or 2, wherein the position specifying unit specifies the position of the partial image based on the motion detected by the motion detecting unit. Gripping detection means for detecting that the user is gripping the second display device,
The information processing unit according to claim 3, wherein the position specifying unit specifies the position of the partial image based on the motion detected by the motion detection unit when the grip detection by the user is detected by the grip detection unit. system. The first display control means includes
The information processing system according to any one of claims 1 to 4, wherein when the index image reaches a boundary of a display area of the first display device, an image other than the image displayed in the display area is displayed. . The second display control means includes
When displaying the display image on the second display device at the first magnification, the image data is reduced and used,
When displaying the partial image on the second display device at the second magnification, the same image data as the image data used when the display image is displayed by the first display control unit is used. Item 6. The information processing system according to any one of Items 1 to 5. The second display control means displays an operation object for performing an operation related to the display image when displaying the display image, and does not display the operation object when displaying the partial image. The information processing system according to any one of 1 to 6 . When the partial image is displayed, the second display control means displays a plurality of operation objects corresponding to each operation related to the display image,
The information processing system according to any one of claims 1 to 7 , wherein the control device includes an object selection unit that receives designation of any one of the displayed operation objects from a user. A first display device;
A second display device separate from the first display device;
First display control means for displaying a display image corresponding to image data on the first display device;
Position specifying means for specifying a position in the display image;
The display image having a first magnification, and a partial image having a second magnification larger than the first magnification, which is a partial image at the position specified by the position specifying unit in the display image, Second display control means for selectively displaying on the second display device,
The first display control means includes
When the partial image is displayed on the second display device by the second display control means, an index image representing the position of the partial image is further displayed on the first display device,
While maintaining the display of the display image, the index image is moved and displayed according to the position specified by the position specifying means ,
The second display control means includes
When the display image is displayed on the second display device, when the enlargement operation for enlarging the display image and displaying the partial image is performed, the partial image is displayed on the second display device. When the display device is displayed, and when the state of the partial image is changed to the state of displaying the image including the partial image, the position of the partial image in the image is retained,
When the enlargement operation is performed again after holding the position, the partial image at the held position is displayed on the second display device,
When the display image is displayed on the second display device, the user performs an operation for scrolling the image displayed on the first display device or the second display device. An information processing system for returning the held position to a predetermined initial position . A control device for displaying an image on a first display device and a second display device separate from the first display device,
First display control means for displaying a display image corresponding to image data on the first display device;
Position specifying means for specifying a position in the display image;
The display image having a first magnification, and a partial image having a second magnification larger than the first magnification, which is a partial image at the position specified by the position specifying unit in the display image, Second display control means for selectively displaying on the second display device,
The first display control means includes
When the partial image is displayed on the second display device by the second display control means, an index image representing the position of the partial image is further displayed on the first display device,
While maintaining the display of the display image, the index image is moved and displayed according to the position specified by the position specifying means ,
The second display control means includes
When the display image is displayed on the second display device, when the enlargement operation for enlarging the display image and displaying the partial image is performed, the partial image is displayed on the second display device. When the display device is displayed, and when the state of the partial image is changed to the state of displaying the image including the partial image, the position of the partial image in the image is retained,
When the enlargement operation is performed again after holding the position, the partial image at the held position is displayed on the second display device,
When the display image is displayed on the second display device, the user performs an operation for scrolling the image displayed on the first display device or the second display device. A control device for returning the held position to a predetermined initial position . Displaying a display image corresponding to the image data on the first display device;
Identifying a position in the display image;
A second display device of the first display device separately from, and the display image of the first magnification, a partial image at the specified position of the display image than the first magnification A partial image with a larger second magnification is selectively displayed on the second display device,
When the partial image is displayed on the second display device, an index image representing the position of the partial image is further displayed on the first display device,
While maintaining the display of the display image, to be displayed by moving the index image according to the specific prior Symbol position location,
When the display image is displayed on the second display device, when the enlargement operation for enlarging the display image and displaying the partial image is performed, the partial image is displayed on the second display device. When the display device is displayed, and when the state of the partial image is changed to the state of displaying the image including the partial image, the position of the partial image in the image is retained,
When the enlargement operation is performed again after holding the position, the partial image at the held position is displayed on the second display device,
When the display image is displayed on the second display device, the user performs an operation for scrolling the image displayed on the first display device or the second display device. An image display method for returning the held position to a predetermined initial position . A controller computer for displaying an image on a first display device and a second display device separate from the first display device;
First display control means for displaying a display image corresponding to image data on the first display device;
Position specifying means for specifying a position in the display image;
The display image having a first magnification, and a partial image having a second magnification larger than the first magnification, which is a partial image at the position specified by the position specifying unit in the display image, An information processing program for functioning as second display control means for selectively displaying on a second display device,
The first display control means includes
When the partial image is displayed on the second display device by the second display control means, an index image representing the position of the partial image is further displayed on the first display device,
While maintaining the display of the display image, the index image is moved and displayed according to the position specified by the position specifying means ,
The second display control means includes
When the display image is displayed on the second display device, when the enlargement operation for enlarging the display image and displaying the partial image is performed, the partial image is displayed on the second display device. When the display device is displayed, and when the state of the partial image is changed to the state of displaying the image including the partial image, the position of the partial image in the image is retained,
When the enlargement operation is performed again after holding the position, the partial image at the held position is displayed on the second display device,
When the display image is displayed on the second display device, the user performs an operation for scrolling the image displayed on the first display device or the second display device. An information processing program for returning the held position to a predetermined initial position . A first display device;
A second display device separate from the first display device;
A control device for displaying an image on the first display device and the second display device;
The controller is
First display control means for displaying a display image corresponding to image data on the first display device;
The second display device selectively selects the display image having the first magnification and a partial image that is a part of the display image and that has a second magnification larger than the first magnification. Second display control means for displaying,
When the second display control means shifts from the state where the partial image is displayed to the state where an image including the partial image is displayed, the second display control means holds the position of the partial image in the image, After the transition, when the user performs an operation for scrolling the image displayed on the first display device or the second display device, the held position is returned to a predetermined initial position. system.

Images