JP6752513B2 - Display control device, display control system and display control method - Google Patents

Description

The present invention relates to a display control device, a display control system, and a display control method, and more particularly to a display control device, a display system, and a display control method that display changes following a series of operations.

In recent years, in the user interface, an animation that changes the screen display according to a series of operations of the user, such as scrolling by a drag operation and enlargement or reduction by a pinch operation with two fingers, has been adopted. Such animation is an effective means for showing the progress of a series of operations or the context of display.

However, in order to realize smooth animation, it is necessary to update the screen display at high speed, and a high processing capacity is required for the CPU (Central Processing Unit).
Further, in the case of the display device 131 having a low processing capacity, the display of the animation may be delayed, and conversely, the operability and comprehensibility may be deteriorated.

Patent Document 1 describes a method of performing drawing at high speed while appropriately switching between drawing by reusing drawing data and normal drawing at the time of drawing events such as scrolling and rotation.

Japanese Unexamined Patent Publication No. 2013-218478

Normally, when drawing a display image, display elements such as an image and an icon are drawn sequentially from the back surface. In such a case, the drawing process is duplicated in the area where the display elements overlap, so that the process takes time. The method described in Patent Document 1 is effective in that the animation itself can be displayed at high speed because the next display screen data is created by reusing the screen data currently displayed.

However, when a fixed display element that is not the target of animation exists in the foreground in the area where the animation processing is performed, such a fixed display element can be specified only by screen information by the method described in Patent Document 1. Instead, the animation is performed including the fixed display element.

Therefore, an object of the present invention is to prevent display elements that are not the target of a series of operations from being displayed on a screen that displays changes that follow the series of operations.

The display control device according to one aspect of the present invention is a display control device that controls a display device including a screen for displaying an image and an input device for inputting an operation, and accepts an operation input to the input device. After displaying the user operation reception unit and the first display element and the second display element on the screen, the user operation reception unit performs a series of operations targeting the first display element on the screen. When accepted, the first display element whose display method has changed following the series of operations is displayed on the screen without displaying the second display element on the screen, and the series of operations . When the operation is completed, the screen is provided with a display processing unit that restores the display of the second display element as it is before receiving the series of operations, and the display processing unit corresponds to the series of operations. The identification is made based on the operation response management unit that specifies the follow-up operation, the follow-up display information storage unit that stores the follow-up display information indicating the first display method of the first display element, and the follow-up display information. The follow-up display information is updated so as to indicate a display method for displaying a part of the first display element according to the follow-up operation, and the updated follow-up display information is changed according to the follow-up operation. Based on the follow-up drawing execution unit that specifies the second display method and generates screen display information for displaying the first display element by the specified second display method, and the screen display information. It is characterized by comprising a screen drawing unit that generates display data indicating the first display element by the specified second display method and sends the display data to the display device.

The display control system according to one aspect of the present invention includes a display device including a screen for displaying an image, an input device for inputting an operation, and the display device and a display control device for controlling the input device. In the system, the display control device is a user operation receiving unit that receives an operation input to the input device, and after displaying the first display element and the second display element on the screen, the user operation. When the reception unit receives a series of operations targeting the first display element on the screen, the second display element is not displayed on the screen and is displayed following the series of operations. The first display element whose method has been changed is displayed on the screen, and when the series of operations is completed, the display of the second display element before receiving the series of operations on the screen is restored as it is. The display processing unit includes an operation response management unit for specifying a tracking operation corresponding to the series of operations, and tracking display information indicating a first display method of the first display element. The follow-up display information so as to show a display method for displaying a part of the first display element according to the specified follow-up operation based on the follow-up display information storage unit that stores the follow-up display information. Is updated to specify the second display method changed according to the follow-up operation from the updated follow-up display information, and the first display element is displayed by the specified second display method. Based on the follow-up drawing execution unit that generates screen display information and the screen display information, display data indicating the first display element is generated by the specified second display method, and the display data is displayed. It is characterized by including a screen drawing unit to be sent to the device.

In the display control method according to one aspect of the present invention, when the first display element and the second display element are displayed on the screen and a series of operations targeting the first display element are accepted, the screen is displayed. When the first display element whose display method has changed following the series of operations is displayed on the screen without displaying the second display element and the series of operations is completed. A display control method for restoring the display of the second display element as it is before receiving the series of operations on the screen, the operation response management unit for specifying the following operation corresponding to the series of operations, and the first. A display that stores follow-up display information indicating a first display method of the display element 1 and displays a part of the first display element according to the specified follow-up operation based on the follow-up display information. The follow-up display information is updated so as to indicate the method, a second display method changed according to the follow-up operation is specified from the updated follow-up display information, and the specified second display method is used. A screen display information for displaying the first display element is generated, and the first display element is displayed on the screen by the specified second display method based on the screen display information. ..

According to one aspect of the present invention, a display element that is not the target of a series of operations can be prevented from being displayed on a screen that displays changes that follow the series of operations.

It is a block diagram for demonstrating the display control device and its peripheral device which concerns on Embodiment 1. FIG. It is a block diagram which shows schematic structure of the display control apparatus which concerns on Embodiment 1. FIG. It is the schematic which shows an example of the display element information in Embodiment 1. FIG. (A) and (B) are schematic views showing a hardware configuration example of the display control device according to the first embodiment. It is a flowchart which shows the operation of the display control device which concerns on Embodiment 1. FIG. (A) to (C) are schematic views showing an example of an image displayed on the display device according to the first embodiment.

Embodiment 1.
FIG. 1 is a block diagram for explaining the display control device 100 and its peripheral devices according to the first embodiment.
The display control device 100 is connected to the input device 130 via the user operation communication line 120. The display control device 100 acquires user operation information from the input device 130.
Further, the display control device 100 is connected to the display device 131 via the display data communication line 121. The display control device 100 provides display data to the display device 131.
The display control system is composed of the display control device 100, the input device 130, and the display device 131.

The input device 130 is a device for the user to perform some operation on the display device 131, and is a touch sensor, a button, a switch, a camera for recognizing a gesture, a distance sensor, and another device at a remote location. A communication device or the like that accepts input from is included.
The display device 131 includes a screen for displaying based on the display data.
In the present embodiment, the input device 130 and the display device 131 are electrostatic touch panels. Therefore, the input device 130 receives an operation from the user via the screen of the display device 131.

FIG. 2 is a block diagram schematically showing the configuration of the display control device 100.
The display control device 100 includes a display element storage unit 101, an input interface unit (hereinafter referred to as an input I / F unit) 102, a user operation reception unit 103, an operation response management unit 104, and a follow-up display information creation unit 105. , Follow-up display information storage unit 106, follow-up drawing execution unit 107, screen display information storage unit 108, screen drawing unit 109, display interface unit (hereinafter referred to as display I / F unit) 110, and display element redrawing. A unit 111 is provided.

Here, the display element storage unit 101, the operation response management unit 104, the follow-up display information creation unit 105, the follow-up display information storage unit 106, the follow-up drawing execution unit 107, the screen display information storage unit 108, the screen drawing unit 109, and the display element re-display. The drawing unit 111 constitutes the display processing unit 112.
The display processing unit 112 displays the first display element and the second display element on the screen of the display device 131, and the user operation reception unit 103 targets the first display element on the screen of the display device 131. When the operation of is accepted, the change of the first display element following a series of operations is displayed on the screen without displaying the second display element on the screen.

The display element storage unit 101 stores display element information indicating a display method of the display element. For example, the display element storage unit 101 stores image data indicating an image of a display element to be displayed on the screen, position information indicating the arrangement thereof, and display element information including size information indicating the size thereof. Here, the resolution of the screen of the display device 131 is 800 horizontal × 600 vertical pixels, and the coordinates of the screen are the x-axis from the upper left corner to the right and the y-axis from the corner to the lower.

FIG. 3 is a schematic view showing an example of display element information.
The display element information 101a is table-type information having a display element column 101b, a position column 101c, a size column 101d, and an image column 101e, and each row is a record for each display element.
The display element column 101b stores the display element name as the display element identification information for identifying the display element.
The position sequence 101c stores position information indicating the position on the screen on which the display element is arranged by the coordinates (x, y).
The size column 101d stores size information indicating the size of the image of the display element.
The image string 101e stores the image data of the display element.

The input I / F unit 102 is a connection interface for transmitting and receiving information to and from the input device 130. For example, the input I / F unit 102 receives user operation information from the input device 130.

The user operation reception unit 103 receives user operation information from the input I / F unit 102, and detects screen operation actions that are a series of operations by the user such as tapping and dragging from the user operation information.
The operation response management unit 104 determines the display element and the follow-up operation as the target for performing the follow-up operation such as scrolling and scaling according to the screen operation action detected by the user operation reception unit 103.

The follow-up display information creation unit 105 creates follow-up display information for displaying an image of a display element displayed during the follow-up operation determined by the operation response management unit 104. For example, the follow-up display information creation unit 105 extracts a record corresponding to the display element that performs the follow-up operation determined by the operation response management unit 104 from the display element information 101a, and creates follow-up display information from the extracted record.
The follow-up display information storage unit 106 stores the follow-up display information created by the follow-up display information creation unit 105.

The follow-up drawing execution unit 107 updates the follow-up display information so as to follow the user operation based on the follow-up display information stored in the follow-up display information storage unit 106. In other words, the follow-up drawing execution unit 107 changes the display method of the display element according to the follow-up operation determined by the operation response management unit 104 based on the follow-up display information stored in the follow-up display information storage unit 106. .. For example, when the follow-up display information storage unit 106 stores the follow-up display information indicating the first display method of the first display information, the follow-up drawing execution unit 107 displays the first display according to the follow-up operation. The follow-up display information is updated so that the method changes to the second display method. Specifically, for example, the follow-up drawing execution unit 107 updates at least one of the position and size of displaying the image of the image data included in the follow-up display information according to the follow-up operation.

The screen display information storage unit 108 stores screen display information indicating an image directly displayed on the screen of a display device 131 such as a liquid crystal display.
The screen drawing unit 109 reads the screen display information stored in the screen display information storage unit 108, and is included in the screen display information based on the image data included in the read screen display information. An image of position and size is drawn, and display data of the image is generated. Then, the screen drawing unit 109 gives the display data to the display device 131 via the display I / F unit 110. As a result, the display device 131 can perform display based on the display data.

After the user operation is completed, the display element redrawing unit 111 refers to the display element information stored in the display element storage unit 101 and records a record related to the display element that was not displayed during the user operation on the screen display information storage unit. The display is restored by adding it to the screen display information stored in 108. In other words, the display element redrawing unit 111 causes the display device 131 to display the display element that is not the operation target when the series of operations by the user is completed.

4A and 4B show the user operation reception unit 103, the operation response management unit 104, the follow-up display information creation unit 105, the follow-up display information storage unit 106, the follow-up drawing execution unit 107, and the screen drawing of the display control device 100. It is the schematic which shows the hardware structure example of the part 109 and the display element redrawing part 111.
A part or all of the user operation reception unit 103, the operation response management unit 104, the follow-up display information creation unit 105, the follow-up display information storage unit 106, the follow-up drawing execution unit 107, the screen drawing unit 109, and the display element redrawing unit 111. For example, as shown in FIG. 4A, it can be configured by a memory 10 and a processor 11 such as a CPU (Central Processing Unit) that executes a program stored in the memory 10. Such a program may be provided through a network, or may be recorded and provided on a recording medium.

Further, a part or all of the user operation reception unit 103, the operation response management unit 104, the follow display information creation unit 105, the follow display information storage unit 106, the follow drawing execution unit 107, the screen drawing unit 109, and the display element redraw unit 111. For example, as shown in FIG. 4B, a single circuit, a composite circuit, a programmed processor, a parallel programmed processor, an ASIC (Application Specific Integrated Circuits) or an FPGA (Field Programmable Gate Array). It can also be configured by the processing circuit 12 such as.

The display element storage unit 101 can be configured by the memory 10 shown in FIG. 4A or a non-volatile memory (not shown), and the follow-up display information storage unit 106 and the screen display. The information storage unit 108 can be configured by the memory 10 shown in FIG. 4A, or a non-volatile memory or a volatile memory (not shown).

Next, the operation of the display control device 100 will be described.
FIG. 5 is a flowchart showing the operation of the display control device 100.
6 (A) to 6 (B) are schematic views showing an example of an image displayed on the display device 131.
First, the user operation reception unit 103 acquires user operation information from the input device 130 (S10).
Here, when the input device 130 is an electrostatic touch sensor, when a series of operations are received from the user, the acquired user operation information becomes an array of coordinate values on the screen touched by the user. Here, based on the display element information 101a shown in FIG. 3, the image IM shown in FIG. 6A is displayed on the screen of the display device 131, and the user can display 2 on the screen. It is assumed that the pinch-out, which is a series of operations for expanding the distance between the touch points of the points, is performed, and the following array of coordinate values is acquired in chronological order from time T1 to time T4.
Time T1: (200,200), (460,275)
Time T2: (180,190), (480,280)
Time T3: (170,180), (500,295)
Time T4: (140,160), (510,300)

The user operation reception unit 103 identifies a screen operation action from user operation information indicating a series of operations (S11).
Here, it is assumed that the user operation reception unit 103 specifies the operation "pinch out", the enlargement ratio "1.47", and the enlargement center (330, 238) as screen operation actions from the user operation information.
The enlargement ratio is the ratio between the distance between the coordinates touched at the start of the series of operations and the distance between the coordinates touched at the end of the series of operations. The magnifying center is the center between the coordinates touched at the beginning of a series of operations.

Next, the operation response management unit 104 determines the screen display element that performs the following operation from the screen operation action and the following operation (S12).
Here, the operation response management unit 104 determines in the display element information 101a shown in FIG. 3 that the display element including the coordinates of the enlargement center in the display area is a display element that performs the following operation. In the example of FIG. 3, since the expansion center is included in the display area of the floor map, the operation response management unit 104 uses the floor map as a display element for performing the follow-up operation. The display area of the display element is specified by the position column 101c and the size column 101d. Further, the number of display elements selected here may be plural.
Further, the operation response management unit 104 determines an operation of "expanding" with the enlargement ratio of "1.47" from the operation "pinch out" and the enlargement ratio of "1.47" as a follow-up operation.

Next, the operation response management unit 104 notifies the follow-up display information creation unit 105 and the display element redrawing unit 111 of the display element that performs the follow-up operation (S13).
Here, the “floor map” is notified to the follow-up display information creating unit 105 as a display element that performs the follow-up operation. The "floor map" which is a display element that performs the following operation is also referred to as a first display element, and the other display elements "overall floor map" and "map display position" are also referred to as a second display element.

Next, the follow-up display information creation unit 105 stores the follow-up display information of the display element that performs the follow-up operation in the follow-up display information storage unit 106 (S14).
In the example of FIG. 6A, only the information indicating the display method of the floor map is stored in the follow-up display information storage unit 106 as the follow-up display information, and the information indicating the display method of the entire floor map and the map display position on the upper right is excluded. Be taken.
In the example of FIG. 6A, the floor map image has the same size as the screen size, but the floor map image is larger than the screen size and does not fit on the screen of the display device 131. However, the tracking display information storage unit 106 stores tracking display information indicating a display method for displaying the entire display element.

Next, the operation response management unit 104 notifies the follow-up drawing execution unit 107 of the operation information indicating the follow-up operation (S15).
Here, as the operation information, the operation information indicating the follow-up operation of the enlargement with the enlargement ratio “1.47” is notified.

Next, the follow-up drawing execution unit 107 updates the screen display information stored in the screen display information storage unit 108 based on the follow-up display information stored in the follow-up display information storage unit 106 (S16).
Here, the follow-up drawing execution unit 107 performs an enlargement process for setting the enlargement ratio to “1.47” on the follow-up display information stored in the follow-up display information storage unit 106. As a result, the follow-up display information updates the follow-up display information so as to indicate a display method when the follow-up operation is performed on the entire floor map. Then, the follow-up drawing execution unit 107 generates screen display information by specifying a display method for displaying only the portion to be displayed on the display device 131 from the updated follow-up display information. Then, the follow-up drawing execution unit 107 stores the generated screen display information in the screen display information storage unit 108.

Next, the screen drawing unit 109 draws an image to be displayed on the display device 131 based on the screen display information stored in the screen display information storage unit 108, and generates display data indicating the drawn image. (S17). Here, the display data of the image IM2 as shown in FIG. 6B is generated. Such display data is output from the display I / F unit 110 to the display device 131, and the image IM2 is displayed. Since the follow-up display information on which the screen display information is based includes only the image data of the floor map, the entire floor map and the map display position are not displayed on the image IM2.

Then, the user operation reception unit 103 determines whether or not a series of operations by the user has been completed (S18). If the series of operations is not completed (No in S18), the process returns to step S15, and the processes of steps S15 to S18 are repeated. On the other hand, when the series of operations is completed, the process proceeds to step S19.

In step S19, the display element redrawing unit 111 refers to the display element information stored in the display element storage unit 101 so that display elements other than the display element notified from the operation response management unit 104 are also displayed. The screen display information stored in the screen display information storage unit 108 is updated.

Then, the screen drawing unit 109 performs drawing processing based on the screen display information stored in the screen display information storage unit 108 (S20). As a result, the image IM3 as shown in FIG. 6C is displayed on the display device 131. In addition to the floor map, the image IM3 also displays the entire floor map and the map display position.

As described above, when the display control device 100 executes the animation, the follow-up display information is created in advance in the state where the display element to be the animation is extracted, so that the current display information is directly referred to and processed. And, at the same processing speed as the updating method, animation processing can be realized without drawing a display element that is not an animation target in an unintended state.

The flowchart of FIG. 5 described above has been described by taking the case where the user inputs a pinch-out as a series of operations as an example, but the present embodiment is not limited to such an example.
For example, when the user inputs scroll as a series of operations, for example, in step S11, the user operation reception unit 103 uses the user operation information as screen operation actions such as operation "scroll", movement amount, and scroll start coordinates. To identify.
Then, in step S12, the operation response management unit 104 determines the display element to perform the following operation based on the scroll start coordinates, and determines the operation of "moving" the display element by the "movement amount" as the following operation. To do.

In the present embodiment, the follow-up display information is created in advance, and the follow-up drawing execution unit 107 updates the screen display information according to the follow-up display information. However, the follow-up drawing execution unit 107 displays the screen display information. Processing and updating may be performed with direct reference. In this case, in the case of an animation in which the number of newly displayed elements such as scrolling and reduction increases, a process of drawing a display element that follows only the new display area is executed. Compared with the present embodiment, it is not necessary to secure the memory capacity for the follow-up display information storage unit 106, but there is a trade-off relationship in which the processing load for executing drawing in the new display area increases.

As described above, according to the present embodiment, when displaying a change following a series of operations on the screen, display elements that are not the target of the series of operations are not displayed on the screen. Therefore, the screen display can be updated at high speed, and the animation corresponding to the series of operations can be smoothly displayed.

Further, according to the present embodiment, when the series of operations is completed, the display elements that are not the operation targets are displayed again, so that the user's operation after the series of operations may be hindered. Absent.

Further, according to the present embodiment, after storing the tracking display information of the display element that is the target of the series of operations in the storage unit, a process corresponding to the change that follows the series of operations for the image is performed. Therefore, display elements that are not the target of a series of operations can be easily deleted from the screen.

Further, according to the present embodiment, since the entire follow-up display information of the display element targeted for the series of operations is subjected to the processing corresponding to the change following the series of operations, the subsequent user's operation. Can be easily dealt with.

100 Display control device, 101 Display element storage unit, 102 Input I / F unit, 103 User operation reception unit, 104 Operation response management unit, 105 Follow-up display information creation unit, 106 Follow-up display information storage unit, 107 Follow-up drawing execution unit, 108 screen display information storage unit, 109 screen drawing unit, 110 display I / F unit, 111 display element redrawing unit, 130 input device, 131 display device.

Claims (4)

A display control device that controls a display device provided with a screen for displaying an image and an input device for inputting an operation.
A user operation reception unit that accepts operations input to the input device, and
When the user operation reception unit receives a series of operations targeting the first display element on the screen after displaying the first display element and the second display element on the screen, the user operation reception unit receives the operation. When the first display element whose display method has changed following the series of operations is displayed on the screen without displaying the second display element on the screen, and when the series of operations is completed. The screen is provided with a display processing unit that restores the display of the second display element as it is before receiving the series of operations .
The display processing unit
An operation response management unit that specifies a follow-up operation corresponding to the series of operations,
A follow-up display information storage unit that stores follow-up display information indicating a first display method of the first display element, and a follow-up display information storage unit.
Based on the follow-up display information, the follow-up display information is updated so as to indicate a display method for displaying a part of the first display element according to the specified follow-up operation, and the updated follow-up is performed. A follow-up drawing execution unit that specifies a second display method changed according to the follow-up operation from the display information and generates screen display information for displaying the first display element by the specified second display method. When,
A screen drawing unit that generates display data indicating the first display element by the specified second display method based on the screen display information and sends the display data to the display device is provided. A featured display control device. The display control device according to claim 1, wherein the display processing unit displays the second display element on the screen when the series of operations is completed. A display control system including a display device having a screen for displaying an image, an input device for inputting an operation, and a display device and a display control device for controlling the input device.
The display control device is
A user operation reception unit that accepts operations input to the input device, and
When the user operation reception unit receives a series of operations targeting the first display element on the screen after displaying the first display element and the second display element on the screen, the user operation reception unit receives the operation. When the first display element whose display method has changed following the series of operations is displayed on the screen without displaying the second display element on the screen, and when the series of operations is completed. The screen is provided with a display processing unit that restores the display of the second display element as it is before receiving the series of operations .
The display processing unit
An operation response management unit that specifies a follow-up operation corresponding to the series of operations,
A follow-up display information storage unit that stores follow-up display information indicating a first display method of the first display element, and a follow-up display information storage unit.
Based on the follow-up display information, the follow-up display information is updated so as to indicate a display method for displaying a part of the first display element according to the specified follow-up operation, and the updated follow-up is performed. A follow-up drawing execution unit that specifies a second display method changed according to the follow-up operation from the display information and generates screen display information for displaying the first display element by the specified second display method. When,
A screen drawing unit that generates display data indicating the first display element by the specified second display method based on the screen display information and sends the display data to the display device is provided. A featured display control system. Display the first display element and the second display element on the screen,
When a series of operations targeting the first display element is accepted, the display method is changed according to the series of operations without displaying the second display element on the screen. This is a display control method for displaying the display element of the above on the screen and restoring the display of the second display element as it is before receiving the series of operations on the screen when the series of operations is completed. ,
An operation response management unit that specifies a follow-up operation corresponding to the series of operations,
The follow-up display information indicating the first display method of the first display element is stored.
Based on the follow-up display information, the follow-up display information is updated so as to indicate a display method for displaying a part of the first display element according to the specified follow-up operation.
From the updated follow-up display information, a second display method changed according to the follow-up operation is specified.
The screen display information for displaying the first display element is generated by the specified second display method.
A display control method characterized in that the first display element is displayed on the screen by the specified second display method based on the screen display information.

Images