JP2008134686A - Drawing program, programmable display, and display system - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a drawing program capable of creating or editing display data, including sign language image data, so that even if an operator is hearing-impaired, an installation can be optimally operated. <P>SOLUTION: The drawing program D is capable of creating or editing using a computer B display data 20 about images or sound displayed or reproduced on a programmable display C. The display data 20 comprises sign language image data 25 synchronized with voice data 26 having meanings corresponding to the image data 25. <P>COPYRIGHT: (C)2008,JPO&INPIT

Description

  The present invention relates to a drawing program capable of creating or editing display data reproduced by a programmable display, and a programmable display capable of reproducing display data created or edited using the drawing program. The present invention relates to a display system in which display data created or edited using the drawing program is transferred to a programmable display and reproduced.

  In the control system, a programmable display is used together with a programmable controller (hereinafter referred to as PLC) in order to control various output devices (such as a solenoid valve and a motor).

  The programmable display acquires the status of the output device or PLC from the PLC, and displays the screen on a display built in the programmable display. In addition, the programmable display device transmits a control instruction from the operator to the PLC or the output device by means such as a touch panel arranged on the display screen.

For example, Patent Document 1 discloses a programmable display that can cope with a change in the specification of the target device without a firmware change.
JP 2003-076406 A

  In recent years, a programmable display device has been developed that can provide guidance to an operator by voice so that even an inexperienced operator can operate the equipment optimally.

  However, the operation guidance by voice is not useful when the operator's hearing is inconvenient. Therefore, it is desired to develop a programmable display capable of operating the equipment optimally even if the operator is a hearing impaired person.

  Therefore, in view of the above problems, the present invention creates or edits display data including image data of sign language in order to allow the equipment to operate optimally even when the hearing of the operator is inconvenient. A drawing program that can be played back, a programmable display that can reproduce the display data created or edited using the drawing program, and the display data that is created or edited using the drawing program in the programmable display It is an object of the present invention to provide a display system for transferring and reproducing.

  In order to solve the above-mentioned problem, according to the first aspect of the present invention, there is provided a drawing program capable of creating or editing display data relating to an image or sound displayed or reproduced on a programmable display by a computer, wherein the display data However, the sign language image data and the voice data having the meaning corresponding to the sign language image data are synchronized with each other.

  According to the drawing program according to the first aspect of the present invention, it is possible to easily create or edit the display data for reproducing the sign language image together with the sound on the programmable display. Therefore, by reproducing the display data created or edited by the drawing program according to the present invention on the programmable display, the operator can follow the guidance of the sign language image even if the operator's hearing is inconvenient. Can be operated and the equipment can be operated optimally.

  According to the drawing program of the first aspect of the invention, the display data displayed or reproduced by the programmable display is configured by synchronizing the sign language image data and the voice data in advance. Therefore, the drawing program according to the present invention does not require a procedure for synchronizing the audio data and the sign language image data in order to match the timing at which the audio is reproduced and the timing at which the sign language image is reproduced. Alternatively, the display data can be easily created or edited by the same procedure as that of the conventional drawing program that has only been edited.

  In the invention of claim 2, in the invention of claim 1, a plurality of types of display parts configured by synchronizing sign language image data representing a certain meaning and audio data having a meaning corresponding to the sign language image data It has a collected library, a plurality of display parts are selected from the library, and a plurality of selected display parts are connected to create display data indicating arbitrary contents. It was.

  As a result, the user can easily create or edit a series of display data composed of sign language image data and audio data containing arbitrary sentences as content. Therefore, for example, the user can remake the display data regarding the operation guidance according to the facility in which the programmable display is used.

  In the invention of claim 3, in the invention of claim 2, when the display data is reproduced in the programmable display, reproduction is performed in units of connected display parts to constitute one display part. The reproduction of the next display component is started on the condition that the reproduction of both the sign language image data and the audio data is completed.

  When the display data is created by connecting the display parts, the reproduction time of the sign language image may be different from the reproduction time of the sound. In such a case, there is a possibility that a deviation occurs between the content of the sign language image reproduced on the programmable display and the content of the sound. According to the drawing program according to the third aspect of the invention, the sign language image data and the sound data are synchronized with the timing of starting the reproduction of the sign language image and the reproduction of the sound in units of display parts (words or phrases). Yes. Therefore, the content of the sign language image reproduced on the programmable display can be matched with the content of the sound without requiring special control in the programmable display.

  According to a fourth aspect of the present invention, in the drawing program according to the second aspect, each of the sign language image data and the sound data includes data relating to a reproduction speed, and the contents and sound of the sign language image reproduced on the programmable display device. The playback speed is adjusted so that at least one of the playback speeds matches the content of the video.

  According to the drawing program according to the invention of claim 4, the reproduction time of the sign language image and the reproduction time of the voice can be matched with each other for display parts (words or phrases). Therefore, by causing the display data created or edited by the drawing program according to the present invention to be reproduced on the programmable display, a shift occurs between the sign language image and the sound without special control on the programmable display. Can be prevented.

  Invention of Claim 5 is a programmable display, Comprising: The data for displays produced in the computer using the drawing program as described in any one of Claims 1-4 is taken in, A sign language image and the said sign language image It is characterized by being able to play back audio having a corresponding meaning at the same time.

  According to the programmable display according to the invention of claim 5, since the sign language image can be reproduced together with the voice, the operator can follow the guidance of the sign language image even if the operator's hearing is inconvenient. Can be operated and the equipment can be operated optimally.

  According to a sixth aspect of the present invention, there is provided a display system including a computer and a programmable display, wherein the display data generated in the computer using the drawing program according to any one of the first to fourth aspects is a programmable display. And a sign language image and a voice having a meaning corresponding to the sign language image are simultaneously reproduced on the programmable display.

  According to the display system of the sixth aspect of the present invention, the display data in which the sign language image data is synchronized with the conventional voice data can be transferred to the programmable display by the same procedure as the conventional voice data. . Therefore, the display system according to the present invention does not require processing for synchronizing sign language image data with audio data, and is easy to handle.

  In addition, in the programmable display included in the display system, the sign language image can be reproduced together with the voice, so that the operator operates the programmable display according to the guidance of the sign language image even when the operator's hearing is difficult. And the equipment can be operated optimally.

  In the present invention, display data for reproducing a sign language image together with a voice on a programmable display can be easily created or edited. Therefore, by reproducing the display data created or edited by the drawing program according to the present invention on the programmable display, the operator can follow the guidance of the sign language image even if the operator's hearing is inconvenient. Can be operated and the equipment can be operated optimally.

  FIG. 1 shows a display system A according to this embodiment. The display system A includes a personal computer B (computer) and a programmable display C, and a drawing program D is installed in the personal computer B. The personal computer B and the programmable display C are connected by a cable, and the display data 20 created or edited by the personal computer B can be transferred to the programmable display C.

  FIG. 2 shows a configuration of a personal computer B included in the display system A. The personal computer B includes a memory unit 1 in which a drawing program D is stored, a control unit 2 that controls the entire device based on the program stored in the memory unit 1, and a display in which an image is displayed according to an instruction from the control unit 2. Unit 3, audio reproduction unit 5 that reproduces audio in response to an instruction from control unit 2, input unit 6 such as a keyboard or mouse that gives commands to control unit 2, and other devices connected to network 8 and data And an interface unit 7 for performing exchange.

  The drawing program D stored in the memory unit 1 of the personal computer B is a program for creating or editing the display data 20 relating to the sound or image displayed or reproduced on the programmable display C by the personal computer B. The drawing program D includes a library 22 configured by collecting a plurality of types of display parts 21, and the user selects an arbitrary display part 21 from the library 22 and displays the display data 20. Can be configured.

  FIG. 3 shows the data structure of the display component 21. The display component 21 is configured by synchronizing sign language image data 25 representing a certain meaning and audio data 26 having a meaning corresponding to the sign language image data 25. For example, sign language image data 25a meaning “thank you” and voice data 26a pronounced “thank you” are synchronized to form one display component 21a. In the present embodiment, the display component 21 means a phrase-unit word such as “left”, “button”, and “please press”.

  More specifically, the display component includes a sign language image data format 27 and an audio data format 28 as shown in FIG. Sign language image format 27 stores sign language image data number 30 and sign language image data 25. Audio data format 28 corresponds to audio data number 31, audio data 26, and audio data 26. Sign language image data number 30 is stored. In the drawing program D according to the present embodiment, the sign language image data 25 and the meaning corresponding to the sign language image data 25 are recorded by recording the sign language image data number 30 corresponding to the speech data 26 in the speech data format 28 as described above. The display component 21 is configured by synchronizing with the audio data 26 having

  Each of the sign language image data 25 and the audio data 26 includes data relating to the reproduction speed. Therefore, the user can adjust the reproduction speed of the sign language image and the sound reproduced on the programmable display C on the personal computer B by inputting an arbitrary reproduction speed from the input unit 6 such as a keyboard.

  When creating or editing the display data 20 using the drawing program D, the user selects the display part 21 from the library 22 configured by collecting a plurality of types of display parts 21 and displays the display data. 20 can be configured. The display component 21 selected by the user from the library 22 may be one or plural.

  When the user selects a plurality of display parts 21, the drawing program D according to the present embodiment connects the selected plurality of display parts 21 to display data 20 indicating arbitrary contents. Can be created. For example, the user selects three display component parts 21 including “left”, “button”, and “please press” from the library 22 and connects the selected display component parts 21 to each other. , The display data 20 having the content “Please press the left button” can be created.

  As a method for the user to select the display component 21, for example, as shown in FIGS. 4 and 5, a library 22 configured by collecting icons 33 indicating the display component 21 on the display unit 3 of the personal computer B. And the image screen 35 of the display unit 13 of the programmable display C are displayed, and the display component 21 is selected by moving the icon 33 from the library 22 into the image screen 35 by drag and drop. Can be configured. Further, by moving a plurality of icons 33 in the image screen 35 in order from the library 22, the display component 21 can be connected in the order in which the icons 33 are moved in the image screen 35. The display data 20 created in this way can be reproduced on the personal computer B and the contents thereof can be confirmed.

  FIG. 6 shows a data structure of the display data 20 created by the drawing program D. The display data 20 is composed of an image part 37 and a sound part 38. A sign language image data format 27 constituting the display device part 21 selected from the library 22 is concatenated and stored in the image unit 37 in the order of reproduction on the display unit 13 of the programmable display C. The audio unit 38 stores the audio data format 28 that constitutes the selected display component connected in the order of reproduction by the audio reproduction unit 15 of the programmable display C.

  FIG. 7 is a configuration diagram showing a programmable display C according to the present embodiment. The programmable display device C displays an image according to an instruction from the memory unit 11 in which a program and data are stored, a control unit 12 that controls the entire device based on the program stored in the memory unit 11, and an instruction from the control unit 12. Display unit 13, audio reproduction unit 15 that reproduces audio according to instructions from control unit 12, input unit 16 that gives instructions to control unit 12, and interface unit 17 that exchanges data with other devices connected to the network And.

  The display data 20 created on the personal computer B using the drawing program D is transferred to the programmable display C via the cable 9 as shown in FIG. The display data 20 received by the interface unit 17 of the programmable display C is stored in the memory unit 11 through the control unit 12.

  Reproduction of the display data 20 on the programmable display C is performed by reading the display data 20 stored in the memory 11 by the control unit 12, reproducing the sign language image on the display unit 13, and reproducing the sign language image on the audio reproduction unit 15. The corresponding sound is played. Specifically, the sign language image data 25 is read by the control unit 12 from the sign language image data format 27 stored in the image portion 37 of the display data 20. Next, the audio data format 28 storing the sign language image data number 30 corresponding to the sign language image data 25 is selected from one or a plurality of audio data formats 28 stored in the audio unit 38 of the display data 20. The audio data 26 stored in the selected audio data format 28 is read by the control unit 12. The sign language image data 25 read by the control unit 12 is reproduced on the display unit 13 of the programmable display C, and the audio data 26 is reproduced simultaneously with the sign language image data 25 in the audio reproduction unit 15.

  As described above, according to the drawing program D according to the present embodiment, the display data 20 for reproducing the sign language image together with the sound on the programmable display C can be easily created or edited. In addition, by reproducing the display data 20 created or edited by the drawing program D according to the present embodiment on the programmable display C, the operator can guide sign language images even when the operator is not hearing. The programmable display C can be operated according to the above, and the equipment can be operated optimally.

  Further, when the display data 20 is generated by connecting the display parts 21 and the display data 20 is reproduced on the programmable display C, the reproduction time of the sign language image may be different from the reproduction time of the sound. . In such a case, there is a possibility that a deviation occurs between the content of the sign language image reproduced on the programmable display C and the content of the sound.

  However, the display data 20 created by the drawing program D according to the present embodiment is reproduced with the display component 21 constituting the display data 20 as one unit as shown in FIG. Reproduction of the next display component 21b is started on the condition that reproduction of both the sign language image data 25a and the audio data 26a constituting the device component 21a is completed. For example, even if the reproduction of the voice data 26a is finished first, the next voice data 26b is not reproduced until the reproduction of the sign language image data 25a is finished, and the reproduction of the sign language image data 25a is finished. The reproduction of the sign language image data 25b and the audio data 26b constituting the next display component 21b is started.

  For this reason, the display data 20 created by the personal computer B using the drawing program D according to the present embodiment is combined with the sign language image and audio playback start timing for each display component 21 unit. The image data 25 and the audio data 26 are synchronized with each other. As a result, the display data 20 created by the drawing program D according to the present embodiment does not require any special control in the programmable display C, and the contents of the sign language image and the sound reproduced in the programmable display C. Can be made to coincide with each other, and a shift between the contents of the sign language image and the contents of the voice can be prevented.

  In the drawing program D according to the present embodiment, the reproduction speed of the sign language image data 25 or the audio data 26 can be adjusted for each display component 21. Therefore, in the drawing program D according to the present embodiment, as shown in FIG. 9, the reproduction time of the sign language image and the reproduction time of the audio can be matched by adjusting the reproduction speed of the audio data 26a to 26c. It is also possible to prevent the shift between the sign language image and the sound without requiring special control by the programmable display C. Note that the adjustment of the reproduction speed is not limited to the audio data 26a to 26c. The reproduction speed of the sign language image data 25a to 25c may be adjusted, and the sign language image data 25a to 25c and the audio data 26a to 26c may be adjusted. Both playback speeds may be adjusted.

  In the above embodiment, the reproduction speed of the sign language image data 25 or the audio data 26 is adjusted on the personal computer B by the user. However, the present invention is not limited to such a configuration. For example, when the sign language image data 25 and the audio data 26 are synchronized, the drawing program D sets the reproduction speed of at least one of the sign language image data 25 and the audio data 26 so that the respective reproduction times coincide with each other. The configuration may be automatically adjusted.

  In the drawing program D of the above embodiment, the word represented by the display component 21 is mainly a phrase unit, but the present invention is not limited to such a configuration. For example, the word represented by the display component 21 may be a word unit such as “left”, “right”, etc., or “please press the left button” or “end work”. It may be a sentence unit such as

  In the above embodiment, the sign part image data number 30 corresponding to the voice data 26 is stored in the voice data format 28, so that the sign language image data 25 and the voice data 26 are synchronized to constitute the display component 21. The present invention is not limited to such a configuration. For example, the sign language image data 25 and the sound data 26 may be synchronized by storing the sound data number 31 corresponding to the sign language image data 25 in the sign language image data format 27.

It is the schematic which shows the display system which concerns on this embodiment. It is a block diagram of the personal computer which uses the drawing program concerning this embodiment. It is a block diagram of the components for a display device used for the drawing program concerning this embodiment. It is an image figure which shows the display screen of the personal computer at the time of starting the drawing program which concerns on this embodiment. It is an image figure which shows the display screen of the personal computer at the time of starting the drawing program which concerns on this embodiment. It is a structure figure of the data for display created by the drawing program concerning this embodiment. It is a block diagram which shows the programmable display which concerns on this embodiment. It is a graph which shows the reproduction time of the sign language image at the time of reproducing | regenerating the display data produced | generated by the drawing program which concerns on this embodiment with a programmable display. It is a graph which shows the reproduction time of the sign language image at the time of reproducing | regenerating the display data produced | generated by the drawing program which concerns on this embodiment with a programmable display.

Explanation of symbols

20 Display Data 21 Display Parts 22 Library 25 Sign Language Image Data 26 Audio Data A Display System B Personal Computer (Computer)
C Programmable display D Drawing program

Claims (6)

  A drawing program capable of creating or editing display data related to an image or sound displayed or reproduced on a programmable display by a computer, wherein the display data has a meaning corresponding to sign language image data and the sign language image data A drawing program characterized by being configured to synchronize with audio data having.   A library in which a plurality of types of display parts configured by synchronizing sign language image data representing a certain meaning and audio data having a meaning corresponding to the sign language image data are collected; 2. The drawing program according to claim 1, wherein a display component is selected, and display data indicating arbitrary contents is created by connecting a plurality of selected display components.   When the display data is reproduced on a programmable display, reproduction is performed in units of connected display parts, and reproduction of both sign language image data and audio data constituting one display part is completed. 3. The drawing program according to claim 2, wherein the reproduction of the next display component is started on the condition.   Each of the sign language image data and audio data includes data related to the reproduction speed, and at least one of the reproduction speeds is adjusted so that the content of the sign language image reproduced on the programmable display matches the content of the audio. The drawing program according to claim 2, wherein the drawing program is executed.   A sign language image and a voice having a meaning corresponding to the sign language image can be simultaneously reproduced by taking in display data created in a computer using the drawing program according to any one of claims 1 to 4. Features programmable display.   A display system comprising a computer and a programmable display, wherein the display data created in the computer using the drawing program according to any one of claims 1 to 4 is transferred to the programmable display, and the programmable display A display system, wherein a sign language image and a voice having a meaning corresponding to the sign language image are simultaneously played back in a device.

Images