JP2014110024A - Display device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a display device making it possible to use a character string acquired from a code symbol with an easy operation.SOLUTION: When a position corresponding to a code image displayed on a display unit 2 is touched on a tablet unit 4, content of a character string obtained by decoding a code symbol represented by the code image is determined, and starting of software, display of the character string itself, or the like is performed in accordance with the determination result. For example, only by a user's long press of the code image, a web page based on a URL acquired from the code image is displayed.

Description

  The present invention relates to a display device including a touch panel.

  A bar code symbol (one-dimensional code symbol) represents code information in which numbers, alphabets, control characters, and the like are encoded by an arrangement of white and black lines, and optically reads and decodes the white and black lines. Thus, data such as a coded character string can be acquired. Since the barcode symbol can easily give identification information to a product or the like, it is used for product identification management in a store or warehouse, product identification management in a factory, and the like. QR code symbols (two-dimensional code symbols) can represent a larger amount of data than one-dimensional bar code symbols, and can also represent e-mail addresses, URLs, hiragana, kana, and kanji characters. Can do.

  These code symbols can be read by, for example, a dedicated reader. However, in a portable terminal device or the like, the code symbols are captured by a digital camera, acquired as image data, read by image processing, and read by a dedicated software. It is also possible to obtain data by decoding.

  In the technique described in Patent Document 1, the content of the two-dimensional code displayed on the display unit can be switched to text information and displayed by operating a button.

JP 2010-133769 A

  However, in the technique described in Patent Document 1, in order to display the text content acquired from the two-dimensional code, a button operation is necessary. For example, a plurality of two-dimensional codes are included in the same image data. If so, display all the included 2D codes as text and temporarily store them in the memory, or copy the displayed text by handwriting on paper etc., then start the application and It is necessary to input text, and the operation for using the character string acquired from the code symbol is extremely complicated.

  An object of the present invention is to provide a display device that can use a character string acquired from a code symbol with a simple operation.

The present invention includes a display unit having a display surface for displaying an image;
A touch panel that is provided over the display surface of the display unit and detects a contact position where an object has contacted;
A code determination unit that determines whether a code image representing a code symbol in which a character string is encoded is included in an image displayed on the display surface;
A decoding unit for decoding a code symbol represented by a code image to obtain a character string;
The code determination unit is configured to determine whether an image displayed on the display surface includes a code image. If the code image is included, the image is displayed on the display surface, and the touch panel is in a contact position. A touch position determination unit that determines whether the detection position detected by the touch panel is a position corresponding to the code image;
If the detection position detected by the touch panel by the touch position determination unit is a position corresponding to the code image, the decoding unit decodes the code symbol represented by the code image and acquires the character And a display control unit that displays columns on the display surface.

The present invention also includes a display unit having a display surface for displaying an image;
A touch panel that is provided over the display surface of the display unit and detects a contact position where an object has contacted;
A code determination unit that determines whether a code image representing a code symbol in which a character string is encoded is included in an image displayed on the display surface;
A decoding unit for decoding a code symbol represented by a code image to obtain a character string;
A character string determination unit that determines whether or not the predetermined character string is included in the character string acquired by the decoding unit;
By inputting the specific character string as input data, a software activation unit that activates software by selecting one software according to the specific character string from a plurality of software that executes a predetermined processing operation;
The code determination unit is configured to determine whether an image displayed on the display surface includes a code image. If the code image is included, the image is displayed on the display surface, and the touch panel is in a contact position. A touch position determination unit that determines whether the detection position detected by the touch panel is a position corresponding to the code image;
If the detection position detected by the touch panel by the touch position determination unit is a position corresponding to the code image, the decoding unit causes the code symbol represented by the code image to be decoded, and the character string The determination unit determines whether the acquired character string includes the specific character string. If the specific character string is included, the software activation unit causes the software activation unit to respond to the specific character string. And a software control unit that activates one piece of software.

In the present invention, the plurality of software includes mail software for executing transmission / reception of an electronic mail,
The software activation unit selects and activates the mail software when the specific character string is an email address.

In the present invention, the plurality of software includes browser software for displaying a web page,
The software activation unit selects and activates the browser software when the specific character string is a URL.

  According to the present invention, the code determination unit determines whether or not a code image is included in the displayed image. If the code image is included, the code is displayed and the touch panel detects the contact position. Then, it is determined whether or not the detection position detected by the touch panel is a position corresponding to the code image. If the detection position detected by the touch panel by the touch position determination unit is a position corresponding to the code image, the decoding unit decodes the code symbol represented by the code image and displays the acquired character string Display on the screen.

  Thereby, the user can use the character string acquired from the code symbol with a simple operation because the character string obtained by decoding the code symbol is displayed only by touching the position corresponding to the code image on the touch panel. .

  Further, according to the present invention, the code determining unit determines whether the displayed image includes a code image. If the code image is included, the code is displayed, and the touch panel detects the contact position. Then, it is determined whether or not the detection position detected by the touch panel is a position corresponding to the code image. If the detection position detected by the touch panel by the touch position determination unit is a position corresponding to the code image, the decoding unit causes the code symbol represented by the code image to be decoded, and the character string determination unit It is determined whether or not the acquired character string includes a specific character string. If the specific character string is included, the software activation unit activates one software corresponding to the specific character string.

  As a result, the user activates the software corresponding to the character string obtained by decoding the code symbol simply by touching the position corresponding to the code image on the touch panel, so that the character string obtained from the code symbol can be used with a simple operation. be able to.

  According to the present invention, the software activation unit selects and activates mail software when the specific character string is a mail address.

  The user can easily start the mail software simply by touching the position corresponding to the code image in which the mail address is encoded.

  The user can start the browser software simply by touching the position corresponding to the code image in which the URL is encoded.

It is a block diagram which shows the structure of the display apparatus 1 which is embodiment of this invention. 4 is a flowchart showing code processing by the display device 1. 4 is a flowchart showing code processing by the display device 1. It is the schematic which shows the web page display process by browser software. It is the schematic which shows the mail preparation process by mail software. It is the schematic which shows a reference destination information display process. It is the schematic which shows a decoding result display process.

  FIG. 1 is a block diagram showing a configuration of a display device 1 according to an embodiment of the present invention. The display device 1 includes a display unit 2, a display control unit 3, a tablet unit 4, a tablet control unit 5, a control unit 6, an operation unit 7, a storage unit 8, a scanner unit 9, and a communication unit 10. With.

  The display unit 2 is a display element having a display surface for displaying an image, and is realized by a liquid crystal display element capable of color display, for example. The display unit 2 may be realized by any one of a transmissive liquid crystal display element capable of color display or monochrome display, a reflective liquid crystal display element, and an electroluminescence (abbreviated as EL) display element.

  The display unit 2 displays an image generated by a basic system program that operates the display device 1, and displays an image generated by software when various software operations described later are performed, an image obtained by reading by the scanner unit 9, and the like. . The present invention is particularly characterized in the operation when a code image is displayed on the display unit 2.

  The display control unit 3 controls the operation of the display unit 2 according to a command from the control unit 6 and causes the display unit 2 to display an image.

  The tablet unit 4 and the tablet control unit 5 are realized by a touch panel. When an object comes into contact with the tablet unit 4, the tablet control unit 5 detects the contact position of the contacted object based on, for example, a coordinate position, and the control unit 6. Send to.

  The control unit 6 is realized by a microcomputer, for example, and controls the entire operation of the display device 1. The control unit 6 includes a decoding unit 6a and a display time measuring unit 6b.

  When the image displayed on the display unit 2 includes a code image representing a code symbol, the decoding unit 6a decodes (decodes) and encodes (encodes) the code symbol of the code image. Get the string that had been saved.

  The display time counting unit 6b measures the display time when reference destination information (to be described later) or a decoding result to be described later is temporarily displayed on the display unit 2.

  The operation unit 7 includes a plurality of keys to which functions are assigned in advance, and the user can input a character string, a control command, and the like by operating the keys.

  The storage unit 8 stores data necessary for the display device 1 to operate, and stores various programs, software, calculation results, and the like. The software stored in the storage unit 8 includes, for example, mail software 8a that executes transmission / reception of electronic mail and browser software 8b that displays web pages.

  The scanner unit 9 includes an imaging lens and an imaging device such as a charge coupled device (CCD) image sensor or a complementary metal-oxide semiconductor (CMOS) image sensor. The scanner unit 9 captures a document placed on the document table, acquires document image data, and transmits the acquired image data to the control unit 6.

  The communication unit 10 is connected to various communication networks such as the Internet and LAN (Local Area Network) by wired communication or wireless communication, and receives image data, HTML (Hyper Text Markup Language) from a web server connected to the various communication networks. ) Acquire data and send / receive e-mail data to / from the mail server.

  In the present invention, both a one-dimensional code (bar code) and a two-dimensional code (QR code (registered trademark)) can be handled in the same manner as code symbols.

  The one-dimensional code is obtained by coding a character string composed of a plurality of characters by expressing numbers, alphabets, kanji, control characters, punctuation characters, and the like by a combination code of black lines and white lines having different thicknesses.

  A QR code symbol obtained by symbolizing a two-dimensional code is a set of modules in which a light module and a dark module are arranged in a square shape, and represents a character string encoded by a module arranged in an encoding area.

  2A and 2B are flowcharts showing code processing by the display device 1. The flowcharts of FIGS. 2A and 2B are started when the display control unit 3 tries to display some image on the display unit 2.

  In step S1, it is determined whether or not the data to be displayed on the display unit 2 is HTML data. If the data to be displayed is HTML data, the process proceeds to step S4. If the data is not HTML data, the process proceeds to step S2.

  In step S2, it is determined whether the scanner unit 9 has been operated. If the scanner unit 9 has been operated, the process proceeds to step S3. If the scanner unit 9 has not been operated, the process returns to step S1.

  If the scanner unit 9 has been operated, the document placed on the document table is scanned to capture document image data.

  In step S4, a barcode image is extracted from the document image based on the document image data. In step S5, it is determined whether or not a barcode image has been extracted. If extracted, the process proceeds to step S6, and if not extracted, the process proceeds to step S11. In step S11, the display unit 2 displays either HTML data or document image data together with an error display indicating that the barcode image has not been extracted.

  In step S6, the position where the code image is displayed is acquired, and either the HTML data or the document image data is displayed on the display unit 2.

  In step S7, it is determined whether or not the tablet unit 4 is touch-operated by an object such as a user's finger or a touch pen. If the tablet unit 4 is touch-operated, the process proceeds to step S7. stand by.

  In step S8, it is determined whether or not the contact position where the object has contacted the tablet unit 4 is a position corresponding to the display position where the code image is currently displayed. The coordinates of the contact position with respect to the tablet unit 4 and the coordinates of the display position on the display surface of the display unit 2 are associated with each other, and the control unit 6 outputs the coordinates of the contact position output from the tablet control unit 5 and the current position. It is determined whether or not the contact position is a position corresponding to the display value of the code image by comparing the coordinates indicating the display position of the code image included in the image displayed on the display surface of the display unit 2. be able to.

  If the contact position of the tablet unit 4 is a position corresponding to the display position where the code image is currently displayed, the process proceeds to step S9, and if it is not the position corresponding to the code image, the process proceeds to step S10.

  In step S9, based on the code image corresponding to the contact position, the code symbol represented by the code image is decoded to obtain a character string. The decoding of the character string based on the code image can be executed by an existing decoding technique. Whether the code image is an image representing a one-dimensional code or an image representing a two-dimensional code, it is possible to obtain a character string by decoding.

  In step S10, since the contact position is different from the code image, the code image includes, for example, page feed by flick operation, scroll by slide operation, icon selection by single tap operation or double tap operation, and software activation. Other processing is performed except for decoding and the process returns to step S7.

  In step S12, it is determined whether or not the contact time with the tablet unit 4 in the touch operation performed on the position corresponding to the code image is a predetermined time or more. This determination is based on whether or not the contact time to the tablet unit 4 is longer than a certain time during the contact with the tablet unit 4 regardless of whether the contact position is the same without changing or the contact position is changed. Judging.

  If the contact time of the touch operation is greater than or equal to a certain time, the process proceeds to step S13, and if the contact time is less than the certain time, the process proceeds to step S20.

  In step S13, it is determined whether a URL (Uniform Resource Locator) is included in the acquired character string. For example, if the character string acquired from the code image includes a character string such as “http” or “https” or an IP address, it is determined that the URL is included in the acquired character string. be able to. If the acquired character string includes a URL, the process proceeds to step S14. If the URL is not included, the process proceeds to step S17.

  If the character string acquired from the code image includes a URL, browser software 8b is activated in step S14.

  A specific character string (URL in the above) included in the acquired character string is associated with software to be activated in advance, and the correspondence relationship is stored in the storage unit 8. Since the display device 1 stores a plurality of software, when a specific character string is included in the character string obtained by decoding the code image, the correspondence between the specific character string included in the software and the software is determined. Based on this, one software is selected and the selected software is activated.

  After starting the browser software 8b in step S14, in step S15, the URL is input to the browser software 8b as input data, and the web server indicated by the URL is accessed.

  In step S16, a web page that can be displayed by the browser software 8b is received from the accessed web server, and the received web page is displayed on the display unit 2 by the browser software 8b.

FIG. 3 is a schematic diagram showing web page display processing by the browser software 8b.
When the user presses and holds the position corresponding to the code image B with a finger while the code image B is displayed on the display unit 2, the browser software 8b is activated, and the code image is displayed in the URL input box 80 of the browser software 8b. The URL obtained by decrypting B is input. The browser software 8b accesses the web server indicated by the input URL, and receives display data for the web page specified by the input URL from the web server. The received display data is analyzed by the browser software 8b and displayed in the display area 81 of the browser software.

  If it is determined in step S13 that the acquired character string does not include a URL, it is determined in step S17 whether the acquired character string includes an e-mail address. For this determination, if the character string acquired from the code image includes, for example, a domain name including “@”, it can be determined that the acquired character string includes a mail address. If the e-mail address is included in the character string, the process proceeds to step S18. If the e-mail address is not included, the process proceeds to step S20.

  If the character string acquired from the code image includes a mail address, the mail software 8a is activated in step S18.

  In step S19, the mail address included in the character string is set as an e-mail destination.

FIG. 4 is a schematic diagram showing mail creation processing by the mail software 8a.
When the user presses and holds a position corresponding to the code image B with a finger while the code image B is displayed on the display unit 2, the mail software 8a is activated. Creation of a new mail is selected from the function of the activated mail software 8a, and the mail address obtained by decrypting the code image B is input to the destination input box 82 of the new mail creation form. Thereafter, the user operates the operation unit 7 and the like, inputs a subject in the subject box 83, inputs a mail body in the mail body input area 84, creates a transmission mail, and then transmits it by the mail software 8a. do it.

  If the touch time on the tablet unit 4 in the touch operation on the code image is less than a certain time, or if the character string acquired from the code image is neither a URL nor an e-mail address, the acquired character string in step S20 It is determined whether or not URL is included. Note that it is determined whether or not the URL is included in this step because it is not determined whether or not the URL is included in the character string when the process proceeds to this step via step S12. . Therefore, when the process goes through step S12, the same determination process as in step S13 is performed.

  On the other hand, when the process proceeds to step S20 via step S13 and step S17, it is already determined in step S13 that the URL is not included in the character string, so that no specific determination process is performed. , It may be determined that the URL is not included.

  If it is determined in step S20 that the URL is included, the process proceeds to step S21. If the URL is not included, the process proceeds to step S23.

  In step S21, URL reference destination information is acquired. Even when the URL is included in the character string obtained by decoding the code image, if the touch operation on the code image is not a long press, the browser software 8b is not activated and the web server represented by the URL is displayed. Information related to the web page or the site including the web page is simply displayed as reference information.

  Information about a web page or site may include, for example, information about the safety or harm of the page or site, thumbnail images that are reduced images of some of the web pages, and some strings extracted from web pages. Including. The information indicating the safety and the harmfulness is transmitted, for example, by transmitting the URL acquired from the code image to the service providing server that provides the evaluation service for evaluating the safety and the harmfulness of the site, and transmitting from the service providing service server. The evaluation result can be used.

FIG. 5 is a schematic diagram showing reference destination information display processing.
When the code image B is displayed on the display unit 2 and the user touches the position corresponding to the code image B with a finger and the touch operation touch time is less than a predetermined time, the web page or site represented by the URL Is displayed in the information display area 20 set so as to be superimposed on the code image B.

  In step S23, the character string itself obtained by decoding the code image is directly displayed as a decoding result.

FIG. 6 is a schematic diagram showing a decoding result display process.
When the code image B is displayed on the display unit 2 and the user touches a position corresponding to the code image B with a finger and the contact time of the touch operation is less than a predetermined time, the code image B is obtained by decoding. The obtained character string is displayed in the decoding result display area 21 set so as to be superimposed on the code image B.

  In step S24, it is determined whether the display time of the reference destination information or the display time of the decoding result has passed a predetermined time, and if it has elapsed, the process proceeds to step S25 to display the displayed reference destination information or decoding result. Clear the display. If the display time has not elapsed, it waits until it elapses.

  Although the case where one code image is displayed on the display unit 2 has been described above, the same code processing can be performed even when a plurality of code images are displayed. For example, when a position corresponding to one code image is touched among a plurality of code images, the above code processing may be performed on the code image. In the case of the reference destination information display process and the decoding result display process, when a plurality of code images are touched, the reference destination information and the decoding result may be displayed so as to overlap each code image at the same time.

  As described above, in the present invention, when the position corresponding to the code image displayed on the display unit 2 is touched with the tablet unit 4, the content of the character string obtained by decoding the code symbol represented by the code image is determined. Then, the software is started and the character string itself is displayed according to the determination result. For example, since the web page based on the URL acquired from the code image is displayed by simply pressing and holding the code image, the user can use the character string acquired from the code image with a simple operation.

DESCRIPTION OF SYMBOLS 1 Display apparatus 2 Display part 3 Display control part 4 Tablet part 5 Tablet control part 6 Control part 6a Decoding part 6b Display time measuring part 7 Operation part 8 Memory | storage part 8a Mail software 8b Browser software 9 Scanner part 10 Communication part 20 Information display area 21 Decoding result display area 80 URL input box 81 Display area 82 Destination input box 83 Subject box 84 Mail text input area B Code image

Claims (4)

A display unit having a display surface for displaying an image;
A touch panel that is provided over the display surface of the display unit and detects a contact position where an object has contacted;
A code determination unit that determines whether a code image representing a code symbol in which a character string is encoded is included in an image displayed on the display surface;
A decoding unit for decoding a code symbol represented by a code image to obtain a character string;
The code determination unit is configured to determine whether an image displayed on the display surface includes a code image. If the code image is included, the image is displayed on the display surface, and the touch panel is in a contact position. A touch position determination unit that determines whether the detection position detected by the touch panel is a position corresponding to the code image;
If the detection position detected by the touch panel by the touch position determination unit is a position corresponding to the code image, the decoding unit decodes the code symbol represented by the code image and acquires the character A display control unit that displays columns on the display surface. A display unit having a display surface for displaying an image;
A touch panel that is provided over the display surface of the display unit and detects a contact position where an object has contacted;
A code determination unit that determines whether a code image representing a code symbol in which a character string is encoded is included in an image displayed on the display surface;
A decoding unit for decoding a code symbol represented by a code image to obtain a character string;
A character string determination unit that determines whether or not the predetermined character string is included in the character string acquired by the decoding unit;
By inputting the specific character string as input data, a software activation unit that activates software by selecting one software according to the specific character string from a plurality of software that executes a predetermined processing operation;
The code determination unit is configured to determine whether an image displayed on the display surface includes a code image. If the code image is included, the image is displayed on the display surface, and the touch panel is in a contact position. A touch position determination unit that determines whether the detection position detected by the touch panel is a position corresponding to the code image;
If the detection position detected by the touch panel by the touch position determination unit is a position corresponding to the code image, the decoding unit causes the code symbol represented by the code image to be decoded, and the character string The determination unit determines whether the acquired character string includes the specific character string. If the specific character string is included, the software activation unit causes the software activation unit to respond to the specific character string. And a software control unit that activates one piece of software. The plurality of software includes mail software for executing transmission / reception of e-mail,
3. The display device according to claim 2, wherein the software activation unit selects and activates the mail software when the specific character string is an email address. The plurality of software includes browser software for displaying a web page,
The display device according to claim 2, wherein the software activation unit selects and activates the browser software when the specific character string is a URL.

Images