TW201833900A - Screen creation supporting apparatus, display system and screen creation supporting method - Google Patents

Abstract

A screen creation supporting apparatus of this invention includes a storage unit which stores a first screen data for displaying a screen for a programmable display device, a calling unit (123) which uses the first screen data stored in the storage unit to arrange a called-out image that is at least a part of the first screen on a second screen to be displayed in a terminal, and an adjusting unit (124) for adjusting the size of the called-out image.

Description

   Screen creation support device, display system, and screen creation support method   

The present invention relates to a screen creation support device, a display system, and a screen creation support method that support screen creation using existing screen data.

Programmable displays are generally connected to devices such as programmable logic controllers (hereinafter referred to as PLC (Programmable Logic Controller)), sensors, driving machines, input and output devices, etc., and are used to display the status of the device and the operation of the device.

In recent years, the demand for displaying the status of the device not only with a programmable display, but also with display devices such as ANDON, large-scale monitors, and mobile terminals is increasing. The so-called Andon system is a display device used at the production site to report the status of production.

Relative to the above requirements, it is possible to consider the use of screen data created for programmable displays to realize the screen display of display devices such as Andon systems, large monitors, and mobile terminals. However, in general, the screen sizes of these display devices and programmable displays are different, so some changes are required to the screen data created for the programmable displays.

On the other hand, when picture data corresponding to various picture sizes are generated in advance, in order to store the picture data in advance, it is necessary to ensure the memory capacity. Patent Literature 1 discloses a screen creation support system capable of suppressing memory capacity and generating screen data corresponding to various screen sizes. The screen creation support system memorized in Patent Literature 1 converts the screen data into relative information screen data composed of relative configuration information with respect to an arbitrary screen, thereby suppressing the memory capacity.

    (Prior technical literature)         (Patent Literature)    

Patent Literature 1: Japanese Patent Application Publication No. 2012-8893

The technology described in Patent Document 1 converts screen data corresponding to each screen size in such a manner that displays having the same screen on various screen sizes can be displayed in response to different screen sizes. The technology described in Patent Document 1 assumes that although the screen sizes of a plurality of display systems are different, they are single in type, that is, all are programmable displays. Therefore, it is no problem to display the same screen in this way. On the other hand, when a display device other than a programmable display, such as an Andon system, a large monitor, and a mobile terminal, is considered, it is expected that the display is not exactly the same as the programmable display. For example, consider that the screen displayed by the programmable display contains additional information to be displayed on the display device, or a part of the screen displayed by the programmable display is deleted for display. In such a case, it is preferable that the existing screen data can be displayed in a size different from the size of the screen set according to the screen size. The technology described in Patent Document 1 originally converts the existing screen data into screen data corresponding to each screen size, so there is a problem that the screen data must be rearranged when adding or deleting information to the converted screen data.

The present invention has been completed in view of the above-mentioned problems, and its object is to obtain a screen creation support device that can easily change the used screen data when using existing screen data to create a display screen.

In order to solve the above-mentioned problems and achieve the objective, the screen creation support device of the present invention includes: a memory section that stores the first screen data belonging to the first screen of the screen data displayed by the programmable display. The screen creation support device includes: a call-out section, which uses the first screen data stored in the memory section to configure a call-out image on a second screen displayed on a device other than a programmable display, and the call-out image belongs to the first screen At least a part of it; and the adjustment part, which adjusts the size of the called image.

The screen creation support device of the present invention can achieve that when the existing screen data is used to create a display screen, the size of the screen data used can be easily changed.

1‧‧‧ Screen creation support device

2‧‧‧Monitor

3‧‧‧terminal

4‧‧‧External machine

5‧‧‧Display system

6‧‧‧ Screen data

7‧‧‧Image attribute information

11, 21, 31‧‧‧ Ministry of Communications

12, 22, 32 ‧‧‧ arithmetic department

13, 23, 33‧‧‧ Memory Department

14, 24, 34‧‧‧ Display

15, 25, 35‧‧‧ input

61‧‧‧Image attribute information

62‧‧‧Object Information Group

101, 302‧‧‧ make screen

102‧‧‧Options

103‧‧‧Call button

121‧‧‧ Screen creation support processing section

122‧‧‧ Production Department

123‧‧‧Call Out Department

124‧‧‧Adjustment Department

125‧‧‧Data generation department

200, 301, 500 ‧‧‧ picture

201‧‧‧ List of screen images

202‧‧‧ button

203‧‧‧OK button

204‧‧‧Cancel button

205, 206‧‧‧ video

207, 303, 600

208‧‧‧Zoom handle

304, 305‧‧‧ switch object

310‧‧‧Call the object selection screen

311‧‧‧Select area

312‧‧‧Region

321‧‧‧ Display Processing Department

322‧‧‧ Acquisition Department

323‧‧‧Display Control Department

401‧‧‧Setting screen

402 to 406, 502‧‧‧ check box

501‧‧‧ List of screen images

503, 504‧‧‧ input field

900‧‧‧Control circuit

901‧‧‧ processor

902‧‧‧Memory

FIG. 1 is a diagram showing a configuration example of a display system according to an embodiment of the present invention.

FIG. 2 is a diagram showing a configuration example of a calculation unit of a display screen creation support device.

FIG. 3 is a diagram showing a configuration example of the arithmetic unit of the terminal.

Fig. 4 is a diagram showing a configuration example of a control circuit.

FIG. 5 is a diagram showing an example of screen information including screen data created by a screen creation support device.

FIG. 6 is a flowchart showing an example of the procedure for creating a screen displayed on a conventional terminal.

FIG. 7 is a diagram showing an example of a state in which a creation screen for new screen creation is displayed.

FIG. 8 is a diagram showing an example of a creation screen in which a screen including a list of screen images and a calling screen are arranged.

Figure 9 is a diagram for explaining the method of calculating the ratio.

Fig. 10 is a diagram showing a configuration example of screen information when a screen called with a screen is created.

FIG. 11 is a diagram showing an example of a screen including a list of screen images and a selection screen of an object to be called.

Fig. 12 is a diagram showing an example of object information when an object to be called is selected in a unit of area.

Fig. 13 is a flowchart showing an example of the processing procedure of the screen display of the terminal.

Fig. 14 is a flowchart showing an example of the automatic size adjustment sequence when a plurality of screens are arranged according to the screen call.

FIG. 15 is a diagram showing an example of the screen displayed in step S42.

Fig. 16 is a diagram showing an example of a setting screen capable of editing.

Fig. 17 is a diagram showing an example of screen data when setting for editing is possible.

Fig. 18 is a diagram showing an example of a creation screen when a screen set to a size that cannot be changed is called as a calling screen.

Hereinafter, the screen creation support device, display system, and screen creation support method according to the embodiment of the present invention will be described in detail based on the drawings. In addition, the present invention is not limited by this embodiment.

    Implementation form.    

FIG. 1 is a diagram showing a configuration example of a display system according to an embodiment of the present invention. The display system 5 of the embodiment includes a screen creation support device 1, a display 2, and a terminal 3. The display 2 can be connected to an external device 4. In the first figure, an example in which the display 2 is connected to the external device 4 is shown.

The external device 4 is a device such as a PLC, a sensor, a driving device, and an input / output device. The display 2 is a programmable display and displays the status of the external device 4. In addition, the display 2 accepts the operation of the external device 4 from the user. The screen creation support device 1 is a device that supports the creation of a screen to be displayed on the display 2 and can store screen data, and the screen data displays data of the prepared screen. Furthermore, the screen creation support device 1 of the present embodiment uses screen data belonging to the data of the screen created for use by the display 2 and can generate screen data that can be displayed on the terminal 3. Hereinafter, the data of the first screen created for use as the display 2 is referred to as existing screen data or first screen data. In addition, although the display 2 of the present embodiment is described as an example of a programmable display, the display 2 may be a display corresponding to existing screen data, and is not limited to a programmable display.

The terminal 3 is a terminal having a communication function with a display unit such as a display or a monitor. The terminal 3 is, for example, an Andon system, a large monitor, a smart phone, or a tablet computer. There is one terminal set 3 shown in the first figure, but the terminal set 3 may also be a plurality of sets. In addition, when the display system 5 includes a plurality of terminal devices 3, the plurality of terminal devices 3 may be configured by different types of devices. For example, a smart phone, an Andon system, and a large monitor may be used as a plurality of terminal devices 3. The terminal 3 of this embodiment can display a screen that uses at least a part of existing screen data created by the display 2.

The screen creation support device 1 of the present embodiment is capable of arranging at least a part of existing screen data on a new screen being created when creating screen data of a new screen. The method of arranging existing screen data in a new screen in this way is called screen calling. The user uses the screen creation support device 1 and arranges the existing screen data on the new screen by calling the screen, and can also arrange other drawing objects on the new screen.

On the other hand, the picture data called by the above picture calling is generally arranged in a new picture with a fixed size. Since the screen call is generally used when a new screen for the display 2 is created, it becomes a size suitable for the display 2. However, the screen size of the terminal 3 is generally different from the screen size of the display 2. In addition, when displayed on the terminal 3, the use may be different from the situation displayed on the display 2. The size of the screen that the user wants to display on the terminal 3 is not necessarily the same as the size of the screen displayed on the display 2. The screen creation support device 1 of this embodiment accepts the change in the size of the screen data called by the screen call. With this, when the screen creation support device 1 uses the existing screen data to create a new screen to be displayed on the terminal 3, the size in which the existing screen data is displayed can be easily changed.

Furthermore, when a general screen creation support device uses part of the existing screen data to create screen data for the terminal 3, it generates screen data obtained by extracting necessary parts from the existing screen data, and by The screen is called to configure the screen data generated by this. On the other hand, the screen creation support apparatus 1 of this embodiment can arrange a new creation screen by the object unit arranged in the called screen data. By this, the user can easily create a screen that uses a part of the existing screen data. The configuration and operation of each component constituting the display system 5 of this embodiment will be described in detail below.

As shown in FIG. 1, the screen creation support device 1 includes a communication unit 11, a calculation unit 12, a storage unit 13, a display unit 14, and an input unit 15. The communication unit 11 communicates with the communication unit 21 of the display 2 which will be described later. The communication system performed between the communication unit 11 and the communication unit 21 may be wired communication or wireless communication. The calculation unit 12 executes the calculation in the screen creation support device 1. In detail, the calculation part 12 performs the process including the screen creation support process of this embodiment. The details of the arithmetic unit 12 will be described later. The memory unit 13 memorizes image information belonging to the set of screen data generated by the computing unit 12. That is, the memory section 13 memorizes the screen information including the first screen data belonging to the screen data for the display 2. The display unit 14 displays the image data including the screen data in accordance with the instruction from the calculation unit 12. The display unit 14 is, for example, a display or a monitor. The input unit 15 accepts input from the user and outputs the received information to the calculation unit 12. The input unit 15 is, for example, a keyboard or a mouse. The display unit 14 and the input unit 15 may be integrated, and the display unit 14 and the input unit 15 may be realized by a touch panel or the like.

FIG. 2 is a diagram showing a configuration example of the arithmetic unit 12 of the display screen creation support device 1. The calculation unit 12 includes a screen creation support processing unit 121 that performs screen creation support processing. The screen creation support processing unit 121 includes a creation unit 122, a calling unit 123, an adjustment unit 124, and a data generation unit 125. The creating unit 122 creates screen data displayed by a device including a display unit mainly including the display 2 and the terminal 3. The calling unit 123 calls the control screen. That is, the calling unit 123 uses the first screen data stored in the memory unit 13 to arrange at least a part of the called images belonging to the first screen on the second screen belonging to the new creation screen. The called image is an image arranged on the created screen, and belongs to all or part of the first screen of the existing screen data. The adjusting unit 124 adjusts the size of the called image that belongs to at least a part of the screen called by the screen calling. The data generating section 125 appends the calling information about the information belonging to the called screen to the screen data.

Returning to the description using FIG. 1, as shown in FIG. 1, the display unit 2 includes a communication unit 21, a calculation unit 22, a memory unit 23, a display unit 24, and an input unit 25. The communication unit 21 performs communication with the communication unit 11 of the screen creation support device 1 and with the terminal 3 to be described later. The communication system performed between the communication unit 21 and the communication unit 31 may be wired communication or wireless communication. The communication between the communication unit 21 and the communication unit 11 and the communication between the communication unit 21 and the communication unit 31 may be communication of the same communication method, or communication of different communication methods.

The calculation unit 22 performs calculation on the display 2. In detail, the calculation unit 22 performs the calculation of the screen data received from the screen preparation support device 1 to the display unit 24 through the communication unit 21 and calculation based on the information input by the user received from the input unit 25 deal with. In addition, when the calculation unit 22 receives the screen information acquisition request from the terminal 3 through the communication unit 21, it reads the screen information from the storage unit 23 and transmits it to the terminal 3 through the communication unit 21. For example, the calculation unit 22 has a Web server function, and the screen information is downloaded to the terminal 3 by the Web server function. Moreover, the calculation part 22 acquires the information which shows the state of the external device 4 from the external device 4, and reflects the acquired information to the screen data which is displayed on the display part 24. The memory unit 23 memorizes the screen information received from the screen creation support device 1 through the communication unit 21. The display unit 24 displays screen data in accordance with instructions from the calculation unit 22. The display unit 24 can be exemplified as a display or a monitor. The input unit 25 accepts input from the user, and outputs the received information to the calculation unit 22. The input unit 25 is, for example, a keyboard or a mouse. The display unit 24 and the input unit 25 may be integrated, and the display unit 24 and the input unit 25 may be realized by a touch panel or the like.

In addition, as shown in FIG. 1, the terminal 3 includes a communication unit 31, a calculation unit 32, a storage unit 33, a display unit 34, and an input unit 35. The communication unit 31 communicates with the communication unit 21 of the display 2. The calculation unit 32 is a calculation performed by the terminal 3. The details of the arithmetic unit 32 will be described later. In detail, for example, the calculation unit 32 displays the screen data received from the display 2 on the display unit 34 through the communication unit 31. The display unit 34 displays screen data in accordance with instructions from the calculation unit 32. The display unit 34 can be exemplified as a display or a monitor. The input unit 35 accepts input from the user, and outputs the received information to the calculation unit 32. The input unit 35 can be exemplified as a keyboard or a mouse. The display unit 34 and the input unit 35 may be integrated, and the display unit 34 and the input unit 35 may be realized by a touch panel or the like.

FIG. 3 is a diagram showing a configuration example of the arithmetic unit 32 of the terminal 3. The arithmetic unit 32 includes a display processing unit 321 that performs the display processing of this embodiment. The display processing unit 321 includes an acquisition unit 322 and a display control unit 323. The obtaining unit 322 obtains the screen information stored in the memory unit 23 of the display 2 through the communication unit 31 and stores it in the memory unit 33. When the display 2 has a Web server function, the acquisition unit 322 is realized by a function of a part of the browser. The user downloads the screen information from the display 2 by operating the input unit 35 of the terminal 3. The display control section 323 reads out the screen data displayed in the screen information stored in the memory section 33, and adjusts the callout screen using the callout screen information appended to the screen data, and then displays the screen data.

Next, the hardware configuration of the above-described computing unit 12, computing unit 22, and computing unit 32 will be described. The arithmetic unit 12, the arithmetic unit 22, and the arithmetic unit 32 are processing circuits. The processing circuit can be a control circuit with a processor or dedicated hardware. Fig. 4 is a diagram showing a configuration example of a control circuit. When the above-mentioned processing circuit is a control circuit, this control circuit is, for example, the control circuit 900 configured as shown in FIG. 4.

The control circuit 900 includes a processor 901 and a memory 902. The processor 901 is a CPU (Central Processing Unit, also referred to as a central processing device, a processing device, a computing device, a microprocessor, a microcomputer, a processor, a DSP (Digital Signal Processor)), or the like. The memory is, for example, non-volatile or volatile semiconductor memory such as RAM (Random Access Memory), ROM (Read Only Memory), flash memory, or magnetic disk.

When the processing circuit is a control circuit 900 equipped with a processor, the processor 901 reads out and executes a program describing the processing of each part stored in the memory 902. In addition, the memory 902 can also be used as a temporary memory in each process performed by the processor 901.

When the processing circuit is dedicated hardware, the processing circuit is, for example, ASIC (Application Specific Integrated Circuit), FPGA (Field Programmable Gate Array), or a combination of these hardware .

Next, the operation of this embodiment will be described. FIG. 5 is a diagram showing an example of screen information including screen data created by the screen creation support device 1. As described above, the screen information is stored in the memory unit 13 of the screen creation support device 1. FIG. 5 shows the state of n screens from the completion of screen 1 to screen n (n is a number of 1 or more) by the user. The screen information includes the screen attribute information 7 belonging to the attribute information of each screen. In addition, the screen data corresponding to one screen includes screen attribute information 7 and object information belonging to information of objects disposed on the screen. In FIG. 5, for example, the screen data 6 belonging to the screen data corresponding to the screen 1 includes screen attribute information 61 and an object information group 62 belonging to a collection of object information. The screen attribute information 61 includes "screen 1" for identifying screen information, and includes screen 1 attribute information. In addition, the example shown in FIG. 5 is that the objects arranged on the screen 1 are m from AAA1-1 to AAA-m (m is an integer of 1 or more). Therefore, the object information group 62 includes object information corresponding to m objects, respectively. The object information includes the category and identification information of the object and the attribute information of the object. AAA1-1 is the category and identification information of each object. AAA displays the information of the category of the object, and then the 1-1, 1-m and other values and symbols of AAA display the number of the screen and the number of the object of the same category in the same screen. For example, AAA1-1 is the first AAA type object in screen 1, AAA1-m is the mth AAA type object in screen 1, and AAA2-1 is the first AAA type object in screen 2. The other screen data constituting the screen information also has the same structure as the screen data 6, but the content of the attribute information and the number of objects are determined according to the screen. Objects of each category are generated in advance as images. For example, when the object type is a counter, an image of the counter is generated in advance as an object. The image information includes image data of each of these pre-generated objects. Alternatively, the image information corresponding to each object may be included in the object information of the screen data.

The screen data constituting the screen information is created by the creating unit 122. The creating unit 122 generates screen data for displaying the screen on the display 2 according to the operation received from the user. The method of generating the screen data used for the screen displayed on the display 2 is not particularly limited, and a general method can be used. For example, when the creation unit 122 receives an instruction to start creation of screen data through the input unit 25, a newly created action screen in a blank state is displayed on the display unit 24. The creation unit 122 displays, for example, a list of selectable objects on the display unit 24, and the user selects the objects through the input unit 25, and sequentially arranges the newly created creation screen. With this, the object is placed on the screen for new creation. When the object is arranged on the screen and the storage instruction is input through the input unit 25, the creating unit 122 stores the data showing the screen on which the object is arranged as the screen data and stores it in the memory unit 13.

Next, the creation of the screen for display on the terminal 3 according to this embodiment will be described. FIG. 6 is a flowchart showing an example of the procedure for creating a screen to be displayed on the terminal 3. When an instruction to start creating a screen to be displayed on the terminal 3 is input through the input unit 15, the processing shown in FIG. 6 is started. The creation unit 122 first displays the creation screen for creating a new screen on the display unit 14 (step S1). FIG. 7 is a diagram showing an example of a state in which a creation screen for new screen creation is displayed. The example shown in FIG. 7 is a creation screen 101 and a menu bar 102 for creating a new screen to be displayed on the display unit 14. The option bar 102 includes a screen calling button 103. When the user wants to configure the existing screen data on the creation screen 101 to be displayed on the terminal 3 by calling the screen, when the input unit 15 is a mouse, the screen call button 103 is clicked. Use this selection screen to call out.

Next, when the screen call is selected through the input unit 15 (Yes in step S2), the call unit 123 displays the screen image list on the display unit 14 and accepts the selection of the call screen (step S3). The screen image list is a list of images corresponding to the screen data. The image corresponding to the screen data is, for example, a reduced image of the screen displayed on the screen data. Alternatively, a list of screen data names or identification information, etc. may be displayed as a screen image list. The following describes an example of displaying a reduced image of a screen corresponding to screen data as a screen image list.

Next, the calling unit 123 determines whether or not the selection of the calling object is instructed (step S4). The so-called selection of the calling object is not to arrange the whole screen in the new screen by calling the screen, but to arrange the objects in the called screen in the new screen in object units The processing being performed. In the selection of the calling object, the user selects the object to be placed on the new screen through the input unit 15, that is, selects the object of the calling object.

When the selection of the calling object is not instructed (No in step S4), the calling unit 123 arranges the calling screen into the screen (step S7). When the selection of the calling object is not instructed, the whole screen called is made into a screen layout. That is, in this case, the called image is the first screen. Fig. 8 is a diagram showing an example of a creation screen in which a screen including a list of screen images and a calling screen are arranged. An example of a screen 200 including a screen image list 201 is displayed on the left side of FIG. 8, and an example of a creation screen on which a call-out screen is arranged is displayed on the right side of FIG. 8. The example shown in FIG. 8 is included in the screen 200, and the screen image list 201 displays the button 202, the OK button 203, and the cancel button 204 belonging to the button for "selecting the object to be called". The screen image list 201 displays a reduced image image 205 belonging to screen 1 and a reduced image image 206 belonging to screen 2. When the user selects the image 205 of the screen image list 201 through the input unit 15 and clicks the OK button 203, the screen data of the screen 1 corresponding to the image 205 is arranged on the creation screen 101. The calling screen 207 displays the screen 1 corresponding to the video 205 arranged on the creation screen 101. When the call-out screen 207 is arranged on the creation screen 101, a zoom handle 208 is displayed together with the call-out screen 207. The user can change the size of the callout screen 207 by operating the zoom handle 208 through the input unit. Before the adjustment, the call-out screen 207 is displayed on the creation screen 101 in the same size as the screen displayed on the display 2, for example.

When receiving the adjustment of the size of the called screen (YES in step S8), the adjustment unit 124 calculates the ratio from the adjusted size, and sets the calculated ratio to the screen data (step S9). Specifically, for example, after the zoom button 208 is operated and a confirm button (not shown) is clicked, the calling unit 123 determines that it has accepted the size adjustment of the called screen. In addition, when the zoom handle 208 is not operated and an OK button (not shown) or the like is clicked, the calling unit 123 determines that the size adjustment of the called screen has not been received.

Figure 9 is a diagram for explaining the method of calculating the ratio. On the left side of FIG. 9, a screen 301 created for the display 2 is displayed, and on the right side of FIG. 9, a creation screen 302 that is being created for display on the terminal 3 is displayed. In the creation screen 302, the screen 301 in FIG. 9 is called as the call-out screen 303 by calling out the screen. As shown in FIG. 9, the size of the screen 301 is set to SX1 × SY1, the size of the created screen 302 is set to DX × DY, and the size of the called screen after the size adjustment is set to OX1 × OY1. In this case, the adjustment unit 124 calculates the ratios X and Y respectively according to the following formula (1). In addition, SX1, DX, and OX1 represent values in the horizontal direction, that is, the X-axis direction, and SY1, DY, OY1 represent values in the vertical direction, that is, the Y-axis direction. Furthermore, the ratio X represents the horizontal ratio, and the ratio Y represents the vertical ratio.

X = OX1 ÷ SX1, Y = OY1 ÷ SY1 ... (1)

In this embodiment, the ratio is used as the information to display the size of the called image. As shown in the above formula (1), the ratio is information indicating the ratio of the size of the called image to the size of the first screen.

Furthermore, the adjustment unit 124 calculates the starting point coordinates PX1 and PY1 in the creation screen 302 of the calling screen 303. The example shown in FIG. 9 is that the starting point coordinates of the switching object 304 belonging to the object in the screen 301 are sox1, soy1, and the starting point coordinates of the switching object 305 corresponding to the switching object 304 in the creation screen 302 are dox1 doy1. sox1, soy1 and dox1, doy1 have the relationship shown in the following formula (2). In addition, for the coordinate values in each screen, the horizontal direction sets the leftward direction as positive, and the vertical direction sets the downward direction as positive.

dox1 = PX1 + sox1 × X, doy1 = PY1 + soy1 × Y ... (2)

When the size adjustment of the called screen is received (No in step S8), the data generating unit 125 judges whether an instruction to end the screen creation has been received (step S10), and when it has been received (Yes in step S10), the The screen data corresponding to the created screen is stored in the memory section 13 and the processing is ended. At this time, when the size adjustment has been performed, the data generating section 125 uses the ratio calculated by the adjusting section 124 to generate object information corresponding to the called screen and append it to the screen data. When the instruction to end the screen creation is not received (No in step S10), the screen creation support processing unit 121 repeatedly performs the process from step S2.

Fig. 10 is a diagram showing a configuration example of screen information when a screen called with a screen is created. In the example shown in FIG. 10, the screen 1 is used as the screen for the display 2 and the screen 2 is used as the screen for the terminal 3. In the screen 2, the screen 1 is arranged according to the calling of the screen. Therefore, the object information corresponding to the screen 2 includes information belonging to the call-out screen 2-1 of the call-out screen arranged on the screen 2. In this way, the callout screen is also handled as an object. The attribute information of the callout screen 2-1 includes the above-mentioned ratios X and Y. In addition, in the example shown in FIG. 10, the attribute information displayed on each screen includes the screen ID (Identifier) and the size, and the attribute information corresponding to the object includes the object ID, the size, and the example of the starting point coordinates. The starting point coordinate is the upper left coordinate of the object in the screen. The object is a square or a rectangle. For example, an object drawn with a circle is also set to include the circle or the square. The screen ID is used to identify the screen number. Furthermore, when the object is a called screen, the attribute information includes the object ID, the screen ID belonging to the called screen ID, the target object ID, the target area, the starting point coordinates, and the ratio. The object ID is used to identify the number of the object. The object ID and the object area are used when it is indicated that there is a selection of an object to be called later. The target object ID and target area will be described later. In addition, when the color of an object is changeable, the attribute information of each object may also include a color.

In step S4, when the selection of the calling object has been instructed (YES in step S4), the calling unit 123 displays the selection screen of the calling object on the display unit 14 (step S5). When the selection of the calling object has been instructed, the calling image is specified by the area or the unit of objects belonging to the image constituting the calling screen. The selection screen of the calling object is a screen for accepting the selection of the object of the calling object. After step S5, the calling unit 123 determines whether the calling object has been selected (step S6), and when the calling object has been selected (YES in step S6), the calling object is placed on the screen (step S7). As will be described later, the calling object is specified by, for example, a region unit or an object unit. In the case specified by the area unit, the objects contained in the area are called out. When the calling object is not selected (No in step S6), the calling unit 123 repeatedly performs step S6.

FIG. 11 is a diagram showing an example of a screen including a list of screen images and a selection screen of an object to be called. The left side of FIG. 11 shows the screen 200 including the screen image list 201, the center of FIG. 11 shows an example of the selection screen 310 to be called, and the right side of FIG. 11 shows the creation screen 101. The screen 200 is the same as the example shown in FIG. 8. In the screen image list 201 of the screen 200, after the image is selected, once the button 202 belonging to the button for "selecting the call target" is selected, the call target selection screen 310 is displayed. The selection screen 310 of the calling object displays the screen corresponding to the image selected in the screen image list 201, that is, the calling screen. In the call-out screen displayed on the call-out target selection screen 310, objects in the call-out screen can be selected in units of regions or objects. When the user selects in object units, the selection button (radio button) on the upper part of the selection screen 310 of the calling object is checked. When selecting in the area unit, the selection of the calling object is checked. The selection button of the "selection area" at the top of the screen 310.

The example shown in FIG. 11 shows a state where the "selected area" is checked and the selected area 311 is selected. The user selects the selection area 311 by, for example, a drag operation. When the selection area 311 is selected, the part corresponding to the selection area 311 in the calling screen is placed on the creation screen 101 as the area 312. As in the case shown in FIG. 8, the user can adjust the size of the area 312 by using the zoom handle. In addition, when "individually selected" is checked, the selection screen 310 of the calling object can be selected in units of objects, and the selected objects can be arranged on the creation screen 101. As in the case shown in Fig. 8, the user can adjust the size of the arranged object by the zoom handle.

Fig. 12 is a diagram showing an example of object information when an object to be called is selected in a unit of area. The example shown in FIG. 12 is based on the screen information. Screen 1 is called as screen 1 in screen 2 and a part of the area in screen 1 is selected as the calling object. The object corresponding to this calling object is the calling screen 2-1 in the example of FIG. 12. In the example shown in Fig. 12, the starting point coordinate and the ending point coordinate of the selected area are stored as object areas in the object information of the calling screen 2-1. In addition, the starting point coordinates and the end point coordinates are represented by the coordinate values in screen 1. The starting point coordinates are the coordinates of the upper left end of the object area, and the ending point coordinates are the coordinates of the lower right end. When a called object is selected in object units, the object ID corresponding to the selected object in the object object ID storage screen 1 is selected. For example, when the counter 1-1 belonging to the object constituting the screen 1 is selected as the object to be called on the screen 2, the object ID 001 belonging to the counter 1-1 is stored in the object information of the calling screen 2-1 The object ID of the object.

Returning to the description of FIG. 6, the calling unit 123 proceeds to step S8 after step S7, and then executes the subsequent steps including step S9. In the case described using FIG. 11, step S8 when the selection of the calling object is performed is to adjust the size of the selected area or the selected object, instead of calling the screen as a whole. Therefore, in step S9 when the selection of the calling object is performed, the calling unit 123 uses the size of the selected area after the size adjustment or the selected object after the size adjustment when calculating the ratio according to the above formula (1) The size is OX1 × OY1.

When the screen call is not selected in step S2 (NO in step S2), the calling unit 123 proceeds to step S10. In addition, when the size adjustment of the calling screen is not accepted in step S8 (NO in step S8), the calling unit 123 proceeds to step S10. In this case, the ratios X and Y are both set to 1.

In the above description, the operation when a screen call is selected has been described, but in addition to the screen call, processing other than the screen call such as creating a new object on the screen can also be implemented. The processing other than the screen call is performed at an arbitrary timing among the processing shown in FIG. 6.

As described above, the screen creation support device 1 generates screen data for the terminal 3 and stores the generated screen data in the memory unit 13. The display 2 obtains the screen information including the screen data for the terminal 3 from the screen preparation support device 1 and stores it in the memory 23. The terminal 3 obtains screen information from the display 2 and uses the screen data for the terminal 3 included in the screen information to implement screen display. In addition, the terminal 3 may acquire image information from the screen creation support device 1 without the display 2.

FIG. 13 is a flowchart showing an example of the processing procedure of the screen display of the terminal 3. First, the terminal 3 obtains screen information from the display 2 (step S21). In detail, the acquisition unit 322 of the terminal 3 transmits a request for acquiring screen information to the display 2 via the communication unit 31. In this way, the computing unit 22 of the display 2 transmits the screen information stored in the memory unit 23 to the terminal 3 via the communication unit 21. The acquisition unit 322 of the terminal 3 receives the screen information transmitted from the display 2 through the communication unit 31 and stores it in the storage unit 33. In addition, the description here is an example in which the terminal 3 obtains the overall screen information, but it may also be the screen data corresponding to the screen of the display object and the screen data called from the screen data. In this case, specifically, for example, the terminal 3 confirms whether the called screen is in the screen data based on the screen information, and obtains the screen data when the called screen is in the screen data.

Next, the display control unit 323 of the terminal 3 obtains the information of the called screen from the screen data of the display object, that is, the object information of the called screen (step S22). In detail, the display control unit 323 extracts the screen data of the display object from the screen information of the memory unit 33, and obtains the information of the called screen from the screen data, that is, the object information of the called screen. The object information of the called screen is exemplified in Figure 12, and includes the object ID, the screen ID, the target object, the target area, and the ratio. In addition, among the information of the object ID, the screen ID, the object object, the object area, and the ratio, the unset information is stored with a value indicating that it is blank or unset. For example, in the case of being called in screen units, the target object and target area become unset information.

Next, the display control unit 323 obtains the screen ID from the information of the called screen, that is, the object information of the called screen (step S23). Next, the display control unit 323 determines whether the information of the called screen, that is, the object information of the called screen is set with the target object ID (step S24). When there is a setting (YES in step S24), the display control unit 323 makes the object of the object ID of the acquired screen ID the display object (step S25). In detail, the display control unit 323 retrieves the screen data of the obtained screen ID from the screen information of the storage unit 33, and retrieves the object information including the corresponding object ID from the object information of the obtained screen data ID holder. The display control unit 323 makes the object of the target object ID obtained by this search the display object.

Next, the display control unit 323 calculates the size and coordinates for displaying the display object from the ratios X and Y in the information of the calling screen, that is, the object information of the calling screen (step S26). The size and coordinates of the display object are the size and starting point coordinates of the callout screen or callout object when the callout screen or callout object is displayed. Specifically, the display control unit 323 uses the ratios X and Y in the object information to calculate the size and coordinates of the display object. The calculation method of the size and coordinates for displaying the display object will be described later.

The display control unit 323 displays the display target on the display unit 34 based on the calculated size and coordinates (step S27), and ends the process. In addition, when it is used to display the creation screen displayed on the terminal 3 other than the calling screen, the object is continuously displayed based on the screen data.

Furthermore, when the target object ID is not set in step S24 (NO in step S24), the display control unit 323 determines whether the target area is set (step S28). When an object area is set (Yes in step S28), the display control unit 323 regards the object in the object area of the screen corresponding to the screen ID acquired in step S23 as the display object (step S29), and proceeds to step S26 go ahead.

When the object area is not set (No in step S28), the display control unit 323 takes all objects in the screen corresponding to the screen ID acquired in step S23 as display objects (step S30), and proceeds to step S26.

The method of calculating the size and coordinates displayed in step S26 will be described. The display control unit 323 determines the size and starting point coordinates of the object in the display screen displayed on the display unit 34 for each object to be displayed in the following manner. The size of the entire display screen displayed on the display unit 34, that is, the size of the created screen described above, is referred to as DX and DY. When the display object is an object specified by the object object ID, the display control unit 323 obtains the object size rx1 from the object information of the object corresponding to the object object ID in the screen data corresponding to the screen ID obtained in step S23 , Ry1. In addition, the display control unit 323 extracts the starting point coordinates PX1 and PY1 from the object information of the callout screen acquired in step S22. The display control unit 323 calculates the dimensions OX1 ' , OY1 ' of the object and the coordinates PX1 ' , PY1 ' of the starting point of the object according to the following equations (3) and (4).

PX1 ' = PX1, PY1 = PY1 ' ... (3)

OX1 ' = rx1 × X, OY1 ' = ry1 × Y (4)

Furthermore, in the case of displaying objects in the target object area, the display control unit 323 extracts the start point coordinates and end point coordinates of the target area from the object information of the callout screen acquired in step S22. From the extracted start point coordinates and end point coordinates and the object information of the screen data corresponding to the screen ID obtained in step S23, the object information of the objects included in the target area among the screen data corresponding to the screen ID is extracted. In this way, for each object, the starting point coordinates bx1, by1 of the object and the size rx1, ry1 of the object are obtained. For each object to be displayed, the display control unit 323 calculates the dimensions OX1 ' , OY1 ' of the display object and the coordinates PX1 ' , PY1 ' of the start point of the display object according to the following equations (5) and (6). PX1 and PY1 are the coordinates of the starting point included in the object information of the called screen obtained in step S22.

PX1 '= PX1 + bx1 × X, PY1 ' = PY1 + by1 × Y ... (5)

OX1 ' = rx1 × X, OY1 ' = ry1 × Y ... (6)

Furthermore, in the case where the display object is an object in the object area, the display control unit 323 applies all the objects constituting the screen data corresponding to the screen ID acquired in step S23 based on the object information using the above formula (5), (6) Calculate the size of the display object OX1 ' , OY1 ' and the coordinates of the starting point of the display object PX1 ' , PY1 ' .

The screen creation support device 1 of the present embodiment may further adjust the size automatically when a plurality of screens are arranged according to the screen call as follows. Fig. 14 is a flowchart showing an example of the automatic size adjustment sequence when a plurality of screens are arranged according to the screen call. When an instruction to start creating a screen displayed on the conventional terminal 3 is input through the input unit 15, the processing shown in FIG. 14 is started. The creation unit 122 first displays the creation screen for creating a new screen on the display unit 14 (step S41). Next, the calling unit 123 judges whether or not plural screen calling is selected (step S42). The selection of multiple screen calls is performed by setting a button for selection of multiple screen calls in the option bar 102 shown in FIG. 7 and by clicking the button. When the plural screen is not selected for calling (No in step S42), the calling unit 123 ends the processing.

When a plurality of screens are selected and called (YES in step S42), the calling unit 123 displays the screen video list on the display unit 14 (step S43). FIG. 15 is a diagram showing an example of the screen displayed in step S42. On the left side of FIG. 15, the screen 500 including the screen video list 501 is displayed on the display unit 14. This screen 500 displays a check box 502 for setting whether to specify and display the division number, an input field 503 for inputting the vertical division number, and an input field 504 for inputting the horizontal division number. When the user specifies and displays the division number, the check box 502 is checked, and the numerical value can be input into the input field 503 and the input field 504. The so-called division number system means a value obtained by dividing the created screen into several pieces and displaying them. For example, if the number of horizontal divisions is specified as 2 and the number of vertical divisions is specified as 2, the screen is determined to be divided into 2 horizontal sections and 2 vertical sections, for a total of 4 divided areas. The divided areas can be individually configured to call out the screen.

When the calling unit 123 selects the called screen and the number of divisions (YES in step S44), it determines the ratio and arrangement corresponding to the number of divisions for the called screens arranged in each divided area (step S45). The configuration is expressed based on, for example, the coordinates of the starting point. The calling unit 123 creates a screen layout according to the determined ratio and layout (step S46). The right side of FIG. 15 shows a state where a plurality of callout screens are displayed on the creation screen 101.

In addition, it is assumed here that the number of divided areas coincides with the number of selected pictures. When the number of selected screens is greater than the number of divided areas, the calling unit 123 may display an error, or may arrange a part of the number of selected called screens on the created screen. When the number of selected screens is smaller than the number of divided regions, the calling unit 123 does not arrange a called screen in a part of the divided regions.

In step S45, the calling unit 123 determines the ratios X, Y and the coordinates of the starting point for each calling screen as described above, for example. The size of the created screen is DX × DY, the number of horizontal divisions is KX, and the number of vertical divisions is KY. The original size of the called screen made for display 2 is set to SX1 and SY1. At this time, the ratios X and Y are calculated by the following formula (7).

X = (DX ÷ KX) ÷ SX1, Y = (DY ÷ KY) ÷ SY1 ... (7)

The starting point coordinates PX _{i, j} , PY _{i, which are} arranged on the i-th (i is an integer of 1 or more) from the left and the j-th (j is an integer of 1 or more) from the top _j is calculated by the following formula (8).

PX _{i, j} = (i-1) × (DX ÷ KX), PY _{i, j} = (j-1) × (DY ÷ KY) ... (8)

Regarding which callout screen is to be placed in which area, any predetermined rule may be used, or it may be set to be selectable by the user.

Returning to the description of FIG. 14, after step S46, it is determined whether the instruction to end the screen creation has been received (step S47), and if it has been accepted (yes in step S47), as in step S10 of FIG. The screen data corresponding to the screen is stored in the memory section 13 to end the processing. At this time, the data generating section 125 uses the calculated ratio and the coordinates of the starting point to generate object information corresponding to the called screen and appends it to the screen data. When the instruction to end the screen creation is not accepted (No in step S47), the screen creation support processing unit 121 repeatedly performs the process from step S42. Normally, the calling process is the process after step S2 in FIG. 6.

As described above, the screen information including the screen data corresponding to the created screen on which the plurality of callout screens are arranged is the same as the screen information including the screen data created by the process of FIG. 6 through the display 2 And receive in terminal 3. The terminal 3 uses the screen information and can perform the processing shown in FIG. 13 to display a screen in which a plurality of call-out screens are arranged. That is, in this case, the called screen is a plurality of first screens, and the calling unit 123 accepts the input of the number of divisions for dividing the new screen, and calculates to arrange the plurality of first screens based on the number of divisions Arrangement positions and sizes of the plurality of first screens of the new screen, and arrange the plurality of first screens on the second screen according to the calculated arrangement positions and sizes.

The screen creation support device 1 of this embodiment may further set whether to edit information on each screen. The creation unit 122 accepts, from the user through the input unit 15, each screen as a call-out screen setting for editing when the call-out screen is called. In other words, when the first screen is used as the calling screen, the creating unit 122 accepts an input indicating whether or not the calling video can be edited. Fig. 16 is a diagram showing an example of a setting screen capable of editing. The setting screen 401 shown in FIG. 16 is displayed on the display unit 14 when the screen is created, for example. The setting screen 401 includes a check box 402 for setting whether to allow size change and a check box 403 for setting whether to allow color change. The setting screen 401 further includes a check box 404 for setting whether to allow the change of the position, a check box 405 for setting whether to allow the addition of the object, and a check box 406 for setting whether to allow the deletion of the object. The creation unit 122 accepts whether or not various edits can be made based on the setting screen 401 shown in FIG. 16, for example.

FIG. 17 is a diagram showing an example of screen data when setting for editing is possible. As shown in Figure 17, the screen data is for each edit item to be edited or not, and contains information showing whether editable or not. That is, the first screen data contains information showing whether editing is possible. Display the information that can be edited or not edited, for example, the editable situation is set to 1, and the uneditable situation is set to 0. Furthermore, Figure 17 shows an example where the color of each object can be changed, and the attribute information includes the color. Fig. 18 is a diagram showing an example of a creation screen when a screen set to a size that cannot be changed is called as a calling screen. In the example shown in FIG. 18, the calling screen 600 does not display the zoom handle for changing the size. When a screen set to a size that can be changed is called, the zoom handle is displayed and the size can be changed.

As described above, the present embodiment uses an existing screen, and when a new screen to be displayed for a device different from the device displaying the existing screen is created, the size of the existing screen to be placed on the new screen is accepted change. This makes it possible to easily change the size of the existing screen data when the existing screen data is used to create a display screen. In addition, in this embodiment, it is possible to select an object to be placed on a new screen in the unit of area or object in the existing screen. With this, a new screen can be flexibly created according to the size and use of the device to be displayed.

The configuration shown in the above embodiment is an example of the content of the present invention, and can be combined with other well-known technologies, and a part of the configuration can be omitted or changed without departing from the gist of the present invention.

Claims (12)

    A screen creation support device includes: a memory unit that stores first screen data belonging to the first screen of the screen data displayed on the programmable display; a calling unit that uses the first screen data stored in the memory unit The called image is arranged on the second screen displayed on the device other than the programmable display, and the called image belongs to at least a part of the first screen; and the adjustment part is to adjust the size of the called image.         The screen creation support device described in item 1 of the patent application scope, wherein the called image is the first screen.         The screen creation support device described in item 1 of the scope of the patent application, wherein the called image is specified based on the area in the first screen.         The screen creation support device as described in item 1 of the scope of the patent application, wherein the called image is designated by an object unit belonging to the image constituting the first screen.         The screen creation supporting device as described in any one of the items 1 to 4 of the patent application scope, wherein the information displaying the size of the called image is appended to the screen data of the second screen.         The screen creation support device as described in item 5 of the patent application scope, wherein the display of the information of the aforementioned size is information indicating the ratio of the size of the called image to the size of the aforementioned first screen.         The screen creation support device as described in item 1 of the patent application range, wherein the called image is a plurality of the first screens, and the calling unit accepts the input of the number of divisions for dividing the second screen according to the number of divisions To calculate an arrangement position and a size of a plurality of the first screens for arranging a plurality of the first screens on the second screen, and according to the calculated arrangement position and size, arrange a plurality of the first screens on the second screen Screen.         The screen creation support device as described in any one of the items 1 to 4, 7 of the patent application scope includes a creation part which is used to display the aforementioned callout when the first screen is used as the recalled image For the input of the information on the possibility of editing the image, the first screen data includes information showing whether the editing is possible.         The screen creation support device as described in item 5 of the patent application scope includes a creation unit that receives the information for displaying the possibility of editing of the recalled image when the first screen is used as the recalled image Input, the first screen data contains information showing whether the editing is possible.         The screen creation support device as described in item 6 of the patent application scope includes a creation unit that accepts information for displaying the possibility of editing the aforementioned recalled image when the first screen is used as the recalled image Input, the first screen data contains information showing whether the editing is possible.         A display system includes: a screen creation support device as described in any one of claims 1 to 10; and a terminal, which displays a screen based on screen data created by the screen creation support device.         A screen creation support method includes: a first step, the screen creation support device memorizes the first screen data of the screen data belonging to the first screen that can be displayed on the programmable display to the memory section; the second step, is the screen creation The supporting device uses the first screen data stored in the memory section to configure a called image on a second screen displayed on a device other than the programmable display, and the called image belongs to at least a part of the first screen; and The third step is to adjust the size of the called image by the screen creation support device.