WO2018159579A1 - Terminal d'affichage/d'opération et système de séparation d'affichage/d'opération utilisant ledit terminal - Google Patents

Terminal d'affichage/d'opération et système de séparation d'affichage/d'opération utilisant ledit terminal Download PDF

Info

Publication number
WO2018159579A1
WO2018159579A1 PCT/JP2018/007129 JP2018007129W WO2018159579A1 WO 2018159579 A1 WO2018159579 A1 WO 2018159579A1 JP 2018007129 W JP2018007129 W JP 2018007129W WO 2018159579 A1 WO2018159579 A1 WO 2018159579A1
Authority
WO
WIPO (PCT)
Prior art keywords
display
terminal
unit
electronic device
input
Prior art date
Application number
PCT/JP2018/007129
Other languages
English (en)
Japanese (ja)
Inventor
晃 高嶋
史朗 菅原
薫 酒井
千登勢 中西
江藤　正幸
由紀子 大湊
Original Assignee
株式会社ｔｅａｍＳ
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 株式会社ｔｅａｍＳ filed Critical 株式会社ｔｅａｍＳ
Publication of WO2018159579A1 publication Critical patent/WO2018159579A1/fr

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M1/00—Substation equipment, e.g. for use by subscribers

Definitions

  • electronic devices that provide the above-described computing environment are typically portable PCs such as smartphones, laptop personal computers (PCs), and tablet terminals.
  • PCs personal computers
  • tablet terminals the use of these electronic devices by users involves various restrictions.
  • a typical example is restrictions based on hardware specifications such as the weight of electronic devices, the power source duration of batteries, and the size.
  • a smartphone has a voice call function as a mobile station, and therefore has a strong restriction on a size suitable for being always carried. Due to this upper size limit, display devices on smartphones are still not always sufficient despite destroying the keyboard and occupying the largest surface of the plate-like housing. Elderly people are difficult to read small letters, and the content that can be enjoyed on a small screen is limited.
  • Electronic book terminals are mainly electronic paper and liquid crystal display devices.
  • Electronic paper ensures the fineness of character-based offset printing as long as it is limited to monochrome and still image display. Even if it is a monochrome still image display, if display with a certain quality is possible, restrictions such as securing a power source and charging, weight, and size related to batteries are less likely to be conscious.
  • the e-book system reduces the weight of publications, the time and effort of management, and the problem of distribution inventory, which greatly benefits users and publishers.
  • the display on the current electronic book terminal that employs electronic pavers is such that the display of text-based displays in publications can be viewed without stress.
  • a screen that is smaller than a traditional publication, although it is an electronic device can sometimes only be tolerated.
  • a liquid crystal display device is employed, the same problems as those of the PC and tablet terminal described above are encountered.
  • Patent Document 1 Utility Model Registration No. 3172006.
  • the present invention makes it a subject to solve at least any one of the various subject mentioned above.
  • the present invention provides a display operation terminal that can utilize a display function and a touch input function that are the same as or similar to those mounted on an electronic device, and a display operation separation system using the display operation terminal. , It makes the user feel as much as possible and draws out the capabilities of electronic devices without any hesitation. As a result, the present invention makes it possible to exert the original appeal even if the content has been halved by the fact that the electronic device has only a small screen. This will contribute to further expansion of the user base. In addition, the present invention feels difficult to use in conventional small electronic devices (for example, smartphones) for physical reasons, or difficult to use in heavy electronic devices (for example, conventional tablet terminals). It also contributes to the expansion of the user base to the people who come.
  • a terminal receiving unit that receives a display signal indicating display content from at least one electronic device, and the display content indicated by the display signal is at least one of a still image and a moving image, or those
  • a terminal display unit having a display area to be presented to the user by combination, a touch operation input unit that receives an input by a touch operation from the user and generates a touch operation signal, and an operation input signal including the touch operation signal
  • a terminal transmission unit that transmits to the electronic device; a communication control unit that controls establishment and release of connection with the electronic device by at least one of the terminal reception unit and the terminal transmission unit; and the terminal reception unit.
  • It can measure the intensity of receivable types of radio waves, and send a detection signal indicating the radio wave intensity received by the terminal receiver A wave intensity detector, and the communication controller controls at least one of the terminal receiver and the terminal transmitter based on the detection signal from the radio wave intensity detector, and the electronic device A display operation terminal for establishing the connection is provided.
  • the display operation terminal of the above aspect can be manufactured in a light weight with a wide display area in principle. This is because capabilities other than the minimum functions necessary for display and input and communication for them can be realized by utilizing the functions of the electronic device. From another viewpoint, for example, a display unit or touch input unit of a size that cannot be used in the past is used for the display operation terminal of the above aspect in comparison with a smartphone or the like that has a practical upper limit. Can do. For this reason, it is possible to provide the user with an easy-to-use operating environment having a larger size for utilizing various functions of the electronic device. In a specific embodiment, since a terminal having minimum necessary functions such as display and touch input is provided, realistic restrictions and obstacles when aiming to reduce the size while reducing the size are removed.
  • the display operation terminal can be thinned to a thickness of about several millimeters, and can be light and flexible, providing an extremely light feeling of use. Ultimately, it would also be possible to realize the appearance of resin boards that are used as “pencil boards” placed on the back of paper when writing on paper with a writing instrument.
  • an electronic device including a device transmission unit that transmits the display signal, and a device reception unit that receives the operation input signal, Display contents for the electronic device are transmitted to the display operation terminal, and a touch operation input for the display operation terminal is transmitted to the electronic device, thereby displaying the display contents of the electronic device and a touch operation for the display contents.
  • a display operation separation system that is executed in the display operation terminal.
  • the hardware of the electronic device included in the display operation separation system of the above aspect can be assumed to be a smartphone equipped with an appropriate communication module, a portable PC such as a laptop PC, and a tablet terminal.
  • a function unit for appropriately transmitting display contents and receiving a touch operation input from the display operation terminal is a display operation terminal.
  • a portable PC such as a smartphone, a laptop PC, and a tablet terminal into an electronic device included in the display operation separation system
  • an appropriate module for example, a communication module
  • these electronic devices can be used in cooperation with the display operation terminal of the above aspect. This enhances the convenience for the user, and also affects the request from the user for the electronic device itself.
  • the display function and input function required for the smartphone itself will not be as important as before, and for example, the user will begin to think that a minimum display size is sufficient. Even in that case, when viewed as a whole display operation separation system combining them, a lighter display operation terminal having an enlarged display unit is provided, which is much higher than conventional electronic devices. Convenience can be realized.
  • the electronic devices include, as representative examples, portable PCs such as smartphones and laptop PCs, and tablet terminals, but are not limited thereto.
  • each element for defining the invention can be realized by arbitrarily combining software and hardware.
  • an element described in the description of the present application by the expression “to part” such as a display unit may be one or more hardware units to realize a target function, and if necessary, In some cases, it is realized by combining one or more units of software components and one or more units of data or information used to realize the characteristics of the hardware as operations or procedures.
  • One unit of the software component at this time includes an application program, an execution library, an API (Application Programming Interface), a protocol stack, a device driver, and the like, and includes a combination of two or more thereof. Even elements defined by the same expression may be realized by different hardware of the same type, and different elements specified by different expressions may be realized by one hardware. In addition, an operation may be specified to define the characteristics of each element, and the order in the operation is not necessarily described in the execution order.
  • FIG. 1 It is a schematic diagram which shows the typical example of operation
  • FIG. 1 it is a schematic diagram showing a configuration of a display operation separation system in which the number of electronic devices is two or more and the number of display operation terminals is one.
  • FIG. 1 is a schematic diagram showing the overall configuration of a display operation separating system 10 of the present embodiment.
  • the display operation separation system 10 typically includes a display operation terminal 100 and an electronic device 200.
  • the display operation terminal 100 includes a terminal reception unit 130, a display unit 110, a touch operation input unit 120, and a terminal transmission unit 140.
  • the terminal receiving unit 130 receives a display signal 132 indicating display content from at least one electronic device 200.
  • the display unit 110 has a display area 110a that presents the display content indicated by the display signal 132 to the user by at least one of a still image and a moving image, or a combination thereof. At least one of a still image and a moving image or a combination thereof includes arbitrary display information such as an image, video, text data, and computer graphic display that can be viewed in the display area 110a.
  • the touch operation input unit 120 receives an input by a touch operation from a user and generates a touch operation signal.
  • the terminal transmission unit 140 transmits an operation input signal 142 including a touch operation signal to the electronic device 200.
  • a typical example of display contents displayed on the display unit 110 of the display operation terminal 100 is the same as the display contents to be displayed on the electronic device 200 and the display contents that should have been displayed.
  • the function of presenting such display contents on a display unit of another device and multiplexing or transferring the display contents is called mirroring in the prior art, and the term is used in this application.
  • the display unit 110 is an arbitrary display device such as an organic EL display (OLED), for example, and the detailed specifications of the display area 110a of the display unit 110 in the display operation terminal 100 are determined in consideration of various viewpoints. .
  • OLED organic EL display
  • the size of the electronic device 200 is generally in a range that does not interfere with carrying at all times.
  • a display area 110a having a larger display capacity (total number of pixels) than that when the electronic device 200 is used alone is provided. Since the display unit 110 having the display unit 110 can be mounted, it is possible to provide a user with a wide area display that is not limited by the size of the display unit 210. Thus, the size of the display area 110a is important in that it is an incentive for the user to add the display operation terminal 100 in addition to the electronic device 200.
  • the display unit 110 of the same size as that of A4 or letter-size paper is also useful for applications that refer to paper-oriented materials.
  • the viewpoint of the balance between the convenience and the manufacturing efficiency described here is appropriately determined according to the intended use including whether the user picks it up, the user group, or the allowable cost.
  • the touch operation input unit 120 can be any touch type input device that allows a user to specify a position limited to at least some extent in order to reflect his / her intention and input with a fingertip.
  • an arbitrary touch input method such as a capacitance method or a resistance film method is employed.
  • the object for specifying the position includes not only the fingertip of the user but also a finger pad, a pen tip subjected to electrical conduction, a pen that operates by electromagnetic induction, and the like, and one or more positions may be specified simultaneously.
  • the touch position detection range of the touch operation input unit 120 typically matches the display area 110a of the display unit 110 or in order to detect an input in a peripheral part outside the outer frame of the display area 110a.
  • the size is slightly larger than the display area 110a.
  • the external appearance of the touch operation input unit 120 and the display unit 110 combined in this way is like an integrated device of a display device and a position input device, which is also called a touch panel.
  • a touch panel For example, ipad (registered trademark) product group of US Apple Inc. Components similar to those of such tablet terminals are lined up.
  • the touch operation input unit 120 that coincides with the display area 110a is made of a material that is transparent to light so that the presence of the touch operation input unit 120 cannot be visually recognized by the user, or is integrated with the display unit 110. It is preferable to do.
  • a touch operation signal is output from the touch operation input unit 120.
  • the display operation terminal 100 performs bidirectional communication with the electronic device 200.
  • the display operation terminal 100 and the electronic device 200 are connected to each other by wireless communication.
  • the electronic device 200 includes a device transmission unit 240 and a device reception unit 230.
  • the terminal receiver 130 communicates with the device transmitter 240, and the terminal transmitter 140 communicates with the device receiver 230.
  • the display content (display content) displayed on the display unit 110 when the user is using the display operation terminal 100 is obtained from the electronic device 200. For this reason, in a situation where the display content from the electronic device 200 is displayed on the display operation terminal 100 and some operation is performed on the display operation terminal 100, the electronic device 200 transmits to the display operation terminal 100 in the bidirectional communication.
  • the terminal reception unit 130 and the device transmission unit 240 are responsible for transferring the display signal 132 indicating the display content, and the terminal transmission unit 140 and the device transmission unit 142 are configured to transfer the operation input signal 142 that conveys the operation input from the display operation terminal 100 to the electronic device 200.
  • the device receiving unit 230 takes charge.
  • the communication connection protocol (communication protocol) that can be adopted for these communications is, for example, Miracast (or WiDi), LTE Direct, Bluetooth (registered trademark) (hereinafter referred to as “BT”), BLE (Bluetooth (registered trademark) Low Energy) and WiFi Direct (both are registered trademarks) can be employed.
  • BT Bluetooth
  • BLE Bluetooth (registered trademark) Low Energy)
  • WiFi Direct both are registered trademarks
  • Two-way communication In the display operation separation system 10 of the present embodiment, communication for the display signal 132 between the terminal receiver 130 and the device transmitter 240 and an operation input signal between the terminal transmitter 140 and the device receiver 230
  • the protocol may be the same or different in both the communication for 142.
  • the display content of the display content included in the communication for the display signal 132 includes an image and a video, and the amount of data is large.
  • the communication for the operation input signal 142 is input data by the touch operation input unit 120, and the data amount is small.
  • an appropriate protocol may be selected and combined separately for each of the communication for the display signal 132 and the communication for the operation input signal 142.
  • the authentication procedure for pairing in the present embodiment It is not essential to carry out as specified.
  • a protocol for communication for the display signal 132 from the electronic device 200 to the display operation terminal 100 it is assumed that bidirectional communication is defined in the protocol and mutual authentication is possible.
  • the display operation separation system 10 according to the present embodiment uses a different protocol used for communication for the operation input signal 142 from the display operation terminal 100 to the electronic device 200 instead of mutual authentication.
  • Mutual authentication is also possible.
  • the display operation separation system 10 according to the present embodiment can be used for various applications and purposes of use. For this reason, as an option, an additional structure and the characteristic can be provided to the structure mentioned above.
  • the display operation terminal 100 after the connection with the electronic device 200 is released does not hold information (data) that can reproduce the display content.
  • the display operation terminal 100 is manufactured by a normal mounting method, the display operation terminal 100 is manufactured as a computing device that operates a microprocessor (not shown) using software (program) and an operating system (OS) for functioning itself. .
  • the display operation terminal 100 also includes a nonvolatile recording medium in accordance with the mounting form.
  • a configuration in which communication contents are temporarily stored in such a nonvolatile recording medium can be considered.
  • the display operation terminal 100 reproduces information that should be concealed at a timing not intended by the user by itself, there is a security risk. For this reason, it is useful to erase the display contents from the above-described nonvolatile storage medium.
  • the display operation terminal 100 further includes an additional finger operation input unit such as a button.
  • the finger operation input unit typically receives an operation input by a finger from the user and is disposed at a position outside the display area 110a. It is useful that such a signal by the finger operation input unit is included in a part of the operation input signal sent by the terminal transmission unit 140 and transmitted to the electronic device.
  • the electronic device 200 to be combined is one in which some kind of finger operation input unit is mounted, it is advantageous that the finger operation input unit in the display operation terminal 100 also performs the same function.
  • the display operation terminal 100 It is also preferable to equip the display operation terminal 100 with an additional input unit other than the finger operation input unit.
  • a sensor for detecting the entire direction and its change can be incorporated in the display operation terminal 100, and the inclination of the entire display operation terminal 100 can be included in a part of the operation input signal. If the whole is tilted and programmed to mean "go forward", the user displays the display content (such as an electronic book) displayed on a page basis and holds the display operation terminal 100 with one hand. The page turning operation can be easily performed while browsing.
  • the entire display operation terminal 100 is made to be at least partially flexible, it is also preferable that the display operation terminal 100 is equipped with a sensor that detects that the user bends.
  • the display operation terminal 100 employed in the display operation separation system 10 of this embodiment is also typically operated by a battery.
  • Wireless power connection has been put into practical use by a non-contact power transmission technology such as Qi (US Wireless Power Consortium). Further, this power connection can be used for charging the internal battery of the display operation terminal 100.
  • the external battery described above is installed in the operation terminal 100 and used for the display operation terminal 100 and the electronic device 200 in close proximity to each other, and in addition to the power of the display operation terminal 100, all of the electric power of the electronic device 200 or It may be something that covers a part.
  • a battery installed in the electronic device 200 can be used as an external battery for the display operation terminal 100.
  • the display operation terminal 100 uses wireless power connection, the connectors can be reduced or eliminated from the display operation terminal 100, so that it is easy to design to improve convenience such as drip-proofing and waterproofing. Therefore, there are fewer obstacles in how to use alcohol sterilization when brought into a sterile room.
  • the display operation terminal 100 as a whole has a certain degree of flexibility and elasticity. Can be granted. Since the display operation terminal 100 having flexibility and elasticity can be used very easily, it is possible to provide the user with maximized convenience.
  • an electronic device 200 used in combination with the display operation terminal 100 in the display operation separation system 10 will be described. If what can become the electronic device 200 is illustrated, a smart phone, portable PC, and a tablet terminal will be typical. These are given a certain degree of portability by themselves, and are expected to be directly operated by the user, and have a display unit (device display unit). Other than these, what can be the electronic device 200 is a desktop PC, a server computer, or the like. It can be said that the requirement for the electronic device 200 is a computing device, which itself provides a display function to a user, accepts input from the user, and implements a necessary communication function.
  • the electronic device 200 of the present embodiment is not limited to this.
  • the necessary hardware requirements are not special.
  • wireless communication with a necessary communication protocol is possible if wireless communication is performed.
  • the electronic device 200 employed in the display / operation separation system 10 has a surface with fewer restrictions than a smartphone that has been used so far.
  • the electronic device 200 may be extremely small. This is because if the display and input can be left to the display operation terminal 100, it is not necessary to increase the size of the display unit in terms of convenience. For this reason, in the case of adopting an existing smartphone for the electronic device 200, if the display operation terminal 100 is of a sufficient size, the request for increasing the size of the electronic device 200 for the purpose of usability is eased. There is practical significance. However, this embodiment does not particularly limit the size of either the display operation terminal 100 or the electronic device 200.
  • the display operation separation system 10 is typically used in a one-to-one connection in which the display operation terminal 100 and the electronic device 200 are combined one by one.
  • the display operation terminal 100 When used in a one-to-one connection, the display operation terminal 100 is typically used in a state where a combination with the electronic device 200 is assumed to some extent.
  • processing for mutual authentication is required.
  • FIG. 2 is a schematic diagram showing a configuration when such a function is implemented in the display operation terminal 100 using this wireless communication.
  • the display operation terminal 100 includes a communication control unit 162, a pairing information recording unit 164, and a radio wave intensity detection unit 166 for the automatic start function.
  • the communication control unit 162 controls establishment and release of connection with the electronic device 200 by the terminal receiving unit 130 and the terminal transmitting unit 140.
  • the pairing information recording unit 164 stores pairing information 164a for registering the electronic device 200 as one of the connection authenticated devices.
  • the pairing information 164a is implemented, for example, in a file format managed on an operating system for causing the display operation terminal 100 to function.
  • the radio wave intensity detection unit 166 is connected to the terminal receiving unit 130 and can determine the intensity of the type of radio waves that can be received, and sends a detection signal 166a that can indicate the received radio wave intensity by the terminal receiving unit 130.
  • the radio wave intensity detection unit 166 detects the radio wave intensity indicating whether or not there is a problem in maintaining the connection after the electronic device 200 and the display operation terminal 100 establish the communication connection.
  • the display operation terminal 100 may employ a technique of, for example, issuing a signal for searching for the electronic device 200 through the terminal transmission unit 140 and detecting a radio wave emitted by the electronic device 200 as a reception confirmation corresponding thereto. it can.
  • the display operation terminal 100 and the electronic device 200 have already been paired in advance, and the electronic device 200 has already been registered as a connection authenticated device in the pairing information 164a of the display operation terminal 100.
  • Registered in the pairing information 164a is general pairing information for wireless communication. For example, Miracast, BT, NFC, etc.
  • the mutual authentication information is first set for pairing. It is of any communication protocol as required.
  • the communication control unit 162 determines whether the received radio wave intensity is stronger than a predetermined intensity reference value based on the detection signal 166a from the radio wave intensity detection unit 166.
  • the communication control unit 162 controls the terminal receiving unit 130 and the terminal transmitting unit 140 to establish a connection with the electronic device 200.
  • the display operation terminal 100 connects to the electronic device 200 with a few steps. It can be established and can provide high convenience to the user.
  • the display operation terminal 100 detects that the electronic device 200 is very close by NFC. At that time, the display content cannot be received by the terminal receiver 130 yet.
  • pairing information for NFC stored in pairing information 164a is used. Since the devices need to be close to each other in order to establish the NFC connection, the detection of the electronic device 200 by the display operation terminal 100 itself becomes the operation of the radio wave intensity detection unit 166.
  • the Miracast connection is established in response to the NFC connection establishment. For this purpose, the pairing information for Miracast stored in the pairing information 164a is used.
  • the display operation terminal 100 can receive the display signal 132 indicating the display content through the terminal receiving unit 130. Further, as a third stage, communication at the BT is established. Also in this case, the pairing information for BT stored in the pairing information 164a is used. Thereby, the display operation terminal 100 can transmit the operation input signal 142 including the touch operation signal to the electronic device 200 by the terminal transmission unit 140.
  • the automatic start function shown in FIG. 2 is also executed when the power is turned on, for example, when the display operation terminal 100 is turned off. If the pairing information recording unit 164 is mounted by a nonvolatile memory or the like, the information is retained even when the power is turned off.
  • the wired communication is set to a higher priority than the wireless communication in the same level of mirroring. Is advantageous.
  • either or both of the terminal receiver 130 and the terminal transmitter 140 further communicate with the electronic device 200 by wired communication.
  • the pairing information by protocol 174a registers an electronic device as one of connection-authenticated devices for wired communication.
  • the trial sequence information 176a stored in the trial sequence setting unit 176 sets the trial order higher than the wireless communication for the wired communication.
  • wired communication unlike wireless communication, it is not always necessary to set a trial time, so the trial time does not necessarily have to be set.
  • the function management control unit 204 It is controlled by the function management control unit 204 so that the screen is returned to a screen that does not include the voice call screen or the home screen that is the default screen for operation. Since this display content is also mirrored on the display operation terminal 100, the display content is presented on the terminal display unit 110.
  • the operation input signal output from the touch operation input unit 120 when the user of the display operation terminal 100 inputs to the touch operation input unit 120 is transmitted to the remote input reception unit 282 via the terminal transmission unit 140 and the device reception unit 230. Accepted. Since this operation is a screen that does not include the voice call screen before the start of the call or is a user input to the home screen, the user does not need to see the voice call screen, and the size of the display operation terminal 100 is reduced.
  • FIG. 8 is a schematic diagram showing a configuration when a touch-type keyboard is displayed on the display operation terminal 100 in the display operation separation system 10 of the present embodiment.
  • the electronic device 200 includes a device display unit 210, a cursor control unit 212, an input control unit 222, and a remote input reception unit 282.
  • the device display unit 210 presents display contents to the user.
  • the cursor control unit 212 displays an input cursor indicating the input position in the input enabled column 210b included in the display content of the device display unit 210.
  • the input control unit 222 controls input display contents at the input position in the device display unit 210.
  • the wireless communication is stopped by releasing the connection from one or both of the electronic device 200 and the display operation terminal 100 after the transmission / reception of the entire unit content is completed.
  • the display operation terminal 100 can display the content related to the display of the unit content stored in the terminal content recording unit 192 on the terminal display unit 110 after the connection with the electronic device 200 is released.
  • the cancellation of the wireless connection described above means that the connection is at least temporarily canceled, and there is a possibility that the connection is established again thereafter.
  • the display operation separation system 10 of the present embodiment can be further devised when the content to be handled is mainly a still image.
  • content mainly composed of still images include, for example, a browsing document file having a plurality of pages, an electronic book file, a web page, a Twitter (registered trademark) screen, a text message application program screen, a mail message screen, Can be mentioned.
  • FIG. 9 also shows the configuration of the display operation separation system 10 used for image content.
  • the device receiving unit 230 of the electronic device 200 receives operation input signals from the first display operation terminal 100A and the second display operation terminal 100B in a distinguished manner from each other.
  • the display contents for the electronic device 200 can be confirmed on both the first display operation terminal 100A and the second display operation terminal 100B, and an input operation to the electronic device 200 is performed from both sides. be able to.
  • the device receiving unit 230 can perform the receiving operation by distinguishing between the first and second display operation terminals 100A and 100B.
  • the device display control unit 288 superimposes a selection prompt 288a on the display content as additional display content for selecting which of the first display operation terminal 100A and the second display operation terminal 100B should accept the operation input signal.
  • the device input receiving unit 286 is configured to receive an input of a selection result from a user of the electronic device.
  • the device input receiving unit 286 receives a signal by touch input from the touch operation input unit 220, for example. Thereafter, the remote input receiving unit 282 operates to selectively receive an operation input signal from either the first display operation terminal 100A or the second display operation terminal 100B according to the selection result.
  • table-type mirroring terminal The versatility of this embodiment is extremely high, and the use of the display operation separation systems 10, 12, and 14 is not limited to the above-described handheld devices. For example, due to the recent generalization of large-sized and high-definition display devices, a sufficiently high-quality display can be realized even if the display of a plurality of electronic devices is simultaneously displayed on one display device. For example, it is realistic to display the respective smartphones brought by a plurality of users on one display device. For example, for a user who is seated facing each side in a table type and shares a table top, a table-integrated terminal in which a display device is arranged on a part or all of the table top ( Also called “table type mirroring terminal”.
  • the same number of mirror image data transmission paths as the number of people who use the table at the same time are mounted on the display operation terminal of this embodiment.
  • This image data transmission path is paired one-to-one with each smartphone.
  • a connection port of a USB terminal is mounted.
  • a screen is mounted on the upper surface of the table top of the table-type mirroring terminal, and a plurality of people can use it in a posture that looks down on the same screen at the same time.
  • An arbitrary number of mirroring screens are displayed in a designated area on the table-type mirroring terminal.
  • the mirroring transmission line can be realized by using Miracast (or WiFi Direct) wirelessly.
  • This connection may be wired.
  • it can be realized by a USB cable connection.
  • the touch input operations of the table-type mirroring terminal are distinguished from each other and transmitted to the respective smartphones by BT connection, cable connection, or the like between each smartphone and the table-type mirroring terminal.
  • the table-type mirroring terminal is equipped with a speaker, it is also useful to synthesize and output all the sound from the connected smartphone from the connected smartphone.
  • the communication control unit it is possible to control to perform bidirectional communication only with a specific communication carrier or a specific electronic device, for example, control of a display operation terminal and display of an image from the electronic device. Furthermore, it is also possible to set the communication carrier or electronic device other than the specific one so that only one direction, for example, an image from the electronic device can be displayed.
  • the present embodiment can be modified in various ways.
  • the electronic device 200 or the display operation terminal 100 according to the present embodiment can be implemented even if configured to be configured by combining functional blocks.
  • a functional block is a functional block that allows users to function independently by preparing parts that should be constituent elements of an electronic device or display / operation terminal in advance so that they have some degree of freedom in combination with each other. This refers to a method that allows users to configure a single terminal by selecting them. The user can realize a necessary function by selecting a function block and connecting the function blocks to each other. Therefore, the function of the electronic device or the display operation terminal can be realized at a cost burden of only the minimum necessary function.
  • Main functional blocks for an electronic device or a display operation terminal that is, a display unit, a battery unit, a WiFi and BT wireless unit, a camera unit, and a television receiving unit are realized as follows.
  • the battery unit is composed of one or more serial signal terminals mainly composed of battery cells and a power management IC.
  • a power supply device or a charging power source is connected to a serial terminal such as a USB
  • the battery cell is charged with the power supplied from the outside by sensing it.
  • a device or a functional block that requires power supply is connected to the serial terminal, the power charged in the battery cell is supplied.
  • the power management IC performs these controls.
  • the WiFi and BT radio units are mainly composed of WiFi signal processing, BT signal processing and RF radio units, and one or more serial terminals. When power is supplied from the serial terminal, the WiFi and BT wireless units start to operate, perform data communication, and output a video signal to the connected display unit.
  • the cellular radio unit is mainly composed of a cellular signal processing unit, an RF radio unit, an antenna unit, and one or more serial terminals.
  • the application CPU unit When the application CPU unit is connected, data to be transmitted / received is exchanged with the application CPU unit, and control itself is operated by a command transmitted from the application CPU unit.
  • the camera unit is mainly composed of a camera body, buttons, and an image processor, and takes an image by pressing a button or an external command.
  • image data is output to the application CPU unit.
  • image data is output to the display unit.
  • the TV receiving unit mainly includes a TV receiving tuner, a TV antenna, a signal processor, and one or more serial terminals.
  • a TV receiving tuner When power is supplied from the outside, the operation starts, and the TV radio wave received by the antenna is demodulated to receive a video signal.
  • the received video signal is output to the application signal processing unit when the application CPU unit is connected, and is output to the display unit when the display unit is connected without being connected.
  • Step 1 Each functional block detects that a new functional block has been added while the terminal type A is realized. This can be realized by periodically inquiring about the connected functional block via the serial terminal. It is determined that each functional block is independently changed to the terminal type B.
  • Step 2 When the application CPU unit is connected, this functional block detects what all the connected functional blocks are, and determines that the terminal type B is changed.
  • Step 3 Software for realizing the terminal type B is activated in each functional block.
  • the display operation terminal of the present invention and the display operation separation system using the same can be used for any computing device.
  • Display operation separation system 100 Display operation terminal 100a One surface 100b The other surface 110 Display unit, terminal display unit 110a Display area 110b Keyboard image 112 Setting prompt 114 Display control unit 116 Cursor search unit 120 Touch operation input unit 122 touch keyboard control unit 130 terminal reception unit 132 display signal 140 terminal transmission unit 142 operation input signal 150 terminal connection terminal group 162 communication control unit, terminal communication control unit 164 pairing information recording unit, terminal pairing information recording unit 164a pairing Information, terminal pairing information 166 radio wave intensity detection unit 166a detection signal 172 reception control unit 174 pairing information recording unit by protocol 174a pairing information by protocol 176 trial sequence setting unit 176a trial Kens information 192 Terminal content recording unit 194 Terminal image content recording unit 200 Electronic device 200A First electronic device 200B Second electronic device 200c Connection surface 202 Voice call processing unit 204 Function management control unit 210 Display unit, device display unit 210a Display area 210b Inputable field 212 Cursor control unit 220 Touch operation input unit 222 Input control unit 230 Device reception unit 240 Device transmission unit 250 Device connection

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Signal Processing (AREA)
  • Computer Hardware Design (AREA)
  • Human Computer Interaction (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

Afin d'améliorer la facilité d'utilisation de l'affichage et de l'entrée avec un appareil électronique, un mode de réalisation de la présente invention concerne un terminal d'affichage/d'opération pourvu d'une unité de réception de terminal (130), d'une unité d'affichage de terminal (110), d'une unité d'entrée d'opération tactile (120) et d'une unité d'émission de terminal (140). L'unité de réception de terminal reçoit, en provenance d'un autre appareil électronique (200), un signal d'affichage (132) indiquant un contenu d'affichage, et l'unité d'affichage de terminal présente, à l'utilisateur et sur une zone d'affichage (110a), une image fixe et/ou une vidéo, ou une combinaison de celles-ci, formant le contenu d'affichage indiqué par le signal d'affichage. L'unité d'entrée d'opération tactile reçoit une entrée d'une opération tactile effectuée par l'utilisateur et génère un signal d'opération tactile, et l'unité d'émission de terminal émet un signal d'entrée d'opération (142) contenant le signal d'opération tactile vers l'appareil électronique. L'utilisateur peut vérifier le contenu d'affichage ou effectuer une entrée d'opération tactile comme s'il utilisait l'appareil électronique, tout en utilisant le terminal d'affichage/d'opération. La présente invention concerne également un système de séparation d'affichage/d'opération comprenant le terminal d'affichage/d'opération et l'appareil électronique.
PCT/JP2018/007129 2017-02-28 2018-02-27 Terminal d'affichage/d'opération et système de séparation d'affichage/d'opération utilisant ledit terminal WO2018159579A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2017-035891 2017-02-28
JP2017035891 2017-02-28

Publications (1)

Publication Number Publication Date
WO2018159579A1 true WO2018159579A1 (fr) 2018-09-07

Family

ID=63370696

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2018/007129 WO2018159579A1 (fr) 2017-02-28 2018-02-27 Terminal d'affichage/d'opération et système de séparation d'affichage/d'opération utilisant ledit terminal

Country Status (1)

Country Link
WO (1) WO2018159579A1 (fr)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP7377108B2 (ja) 2019-04-22 2023-11-09 北京小米移動軟件有限公司 無線充電システム、無線充電装置及び無線受電装置

Citations (19)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2002198887A (ja) * 2000-12-25 2002-07-12 Shin Caterpillar Mitsubishi Ltd 作業機械用の通信制御方法およびその装置
JP2002202941A (ja) * 2000-08-25 2002-07-19 4C Soft Inc マルチメディア電子学習システムおよび学習方法
JP2003244343A (ja) * 2002-02-21 2003-08-29 Toyota Motor Corp 表示装置、携帯端末及び情報表示システム
JP2006512794A (ja) * 2002-07-12 2006-04-13 ソニー・エリクソン・モバイルコミュニケーションズ， エービー 着脱可能なアクティブハウジングと関連コネクタを備えた無線通信端末
JP2010530110A (ja) * 2007-06-29 2010-09-02 ノキア コーポレイション オフラインブラウジングのためのコンテンツをダウンロードするシステム、方法、装置及びコンピュータプログラム製品
JP2011176591A (ja) * 2010-02-24 2011-09-08 Nec Corp 携帯端末を用いた無線通信システム
JP2012019413A (ja) * 2010-07-08 2012-01-26 Toshiba Corp 表示システム、端末装置、表示装置、及びプログラム
US20120242687A1 (en) * 2011-03-25 2012-09-27 Choi Sungha Image processing apparatus and image processing method
US20130113717A1 (en) * 2011-11-09 2013-05-09 Peter Anthony VAN EERD Touch-sensitive display method and apparatus
JP2013536613A (ja) * 2010-07-10 2013-09-19 アイシーイー コンピューター、インコーポレイテッド インテリジェントプラットフォーム
JP2013219420A (ja) * 2012-04-04 2013-10-24 Denso Corp 通信装置、プログラムおよび通信確立方法
JP2013228562A (ja) * 2012-04-25 2013-11-07 Sharp Corp 表示装置、送信装置、表示システム、表示装置の制御方法、送信装置の制御方法、制御プログラムおよび記録媒体
JP2014525065A (ja) * 2011-05-31 2014-09-25 アップル インコーポレイテッド 文書操作のためのデバイス、方法及びグラフィカルユーザインタフェース
JP2014236351A (ja) * 2013-05-31 2014-12-15 株式会社アイ・オー・データ機器 通信接続システムおよび通信接続システムのプログラム
JP2015133577A (ja) * 2014-01-10 2015-07-23 株式会社Ｎｔｔドコモ 通信装置、通信方法及びプログラム
JP2015191487A (ja) * 2014-03-28 2015-11-02 株式会社日立ソリューションズ プレゼンテーションサーバ及びモバイル端末
JP2016046797A (ja) * 2014-08-25 2016-04-04 現代自動車株式会社Ｈｙｕｎｄａｉｍｏｔｏｒ Ｃｏｍｐａｎｙ 有線連結を介したブルートゥースペアリング方法
WO2016084485A1 (fr) * 2014-11-27 2016-06-02 ソニー株式会社 Dispositif et procédé de traitement d'informations
JP2016219416A (ja) * 2015-05-18 2016-12-22 株式会社半導体エネルギー研究所 蓄電体および電子機器

Patent Citations (19)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2002202941A (ja) * 2000-08-25 2002-07-19 4C Soft Inc マルチメディア電子学習システムおよび学習方法
JP2002198887A (ja) * 2000-12-25 2002-07-12 Shin Caterpillar Mitsubishi Ltd 作業機械用の通信制御方法およびその装置
JP2003244343A (ja) * 2002-02-21 2003-08-29 Toyota Motor Corp 表示装置、携帯端末及び情報表示システム
JP2006512794A (ja) * 2002-07-12 2006-04-13 ソニー・エリクソン・モバイルコミュニケーションズ， エービー 着脱可能なアクティブハウジングと関連コネクタを備えた無線通信端末
JP2010530110A (ja) * 2007-06-29 2010-09-02 ノキア コーポレイション オフラインブラウジングのためのコンテンツをダウンロードするシステム、方法、装置及びコンピュータプログラム製品
JP2011176591A (ja) * 2010-02-24 2011-09-08 Nec Corp 携帯端末を用いた無線通信システム
JP2012019413A (ja) * 2010-07-08 2012-01-26 Toshiba Corp 表示システム、端末装置、表示装置、及びプログラム
JP2013536613A (ja) * 2010-07-10 2013-09-19 アイシーイー コンピューター、インコーポレイテッド インテリジェントプラットフォーム
US20120242687A1 (en) * 2011-03-25 2012-09-27 Choi Sungha Image processing apparatus and image processing method
JP2014525065A (ja) * 2011-05-31 2014-09-25 アップル インコーポレイテッド 文書操作のためのデバイス、方法及びグラフィカルユーザインタフェース
US20130113717A1 (en) * 2011-11-09 2013-05-09 Peter Anthony VAN EERD Touch-sensitive display method and apparatus
JP2013219420A (ja) * 2012-04-04 2013-10-24 Denso Corp 通信装置、プログラムおよび通信確立方法
JP2013228562A (ja) * 2012-04-25 2013-11-07 Sharp Corp 表示装置、送信装置、表示システム、表示装置の制御方法、送信装置の制御方法、制御プログラムおよび記録媒体
JP2014236351A (ja) * 2013-05-31 2014-12-15 株式会社アイ・オー・データ機器 通信接続システムおよび通信接続システムのプログラム
JP2015133577A (ja) * 2014-01-10 2015-07-23 株式会社Ｎｔｔドコモ 通信装置、通信方法及びプログラム
JP2015191487A (ja) * 2014-03-28 2015-11-02 株式会社日立ソリューションズ プレゼンテーションサーバ及びモバイル端末
JP2016046797A (ja) * 2014-08-25 2016-04-04 現代自動車株式会社Ｈｙｕｎｄａｉｍｏｔｏｒ Ｃｏｍｐａｎｙ 有線連結を介したブルートゥースペアリング方法
WO2016084485A1 (fr) * 2014-11-27 2016-06-02 ソニー株式会社 Dispositif et procédé de traitement d'informations
JP2016219416A (ja) * 2015-05-18 2016-12-22 株式会社半導体エネルギー研究所 蓄電体および電子機器

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP7377108B2 (ja) 2019-04-22 2023-11-09 北京小米移動軟件有限公司 無線充電システム、無線充電装置及び無線受電装置

Similar Documents

Publication Publication Date Title
CN103577066B (zh) 电子装置和使用电子装置的电子笔记系统
US20220197581A1 (en) Mobile terminal and electronic device having mobile terminal
EP3086538A1 (fr) Système de communication et terminal mobile utilisant ledit terminal
JP6509695B2 (ja) 移動端末機及びその制御方法
KR102626633B1 (ko) 단말기 및 그 제어 방법
US20130109371A1 (en) Computing device operable to work in conjunction with a companion electronic device
KR20160013748A (ko) 휴대 전자기기 및 그것의 제어방법
KR101917696B1 (ko) 이동 단말기 및 그것의 제어 방법
KR101642808B1 (ko) 이동단말기 및 그 제어방법
KR102223728B1 (ko) 이동단말기 및 그 제어방법
JP7146951B2 (ja) 移動端末機および移動端末機を備える電子機器
KR20180037844A (ko) 이동 단말기
US20210278942A1 (en) Mobile terminal, an electronic device having a mobile terminal, and control method of the electronic device
KR102247893B1 (ko) 이동 단말기 및 그것의 통신 시스템
JP2016201090A (ja) 移動端末機及びその制御方法
KR102674753B1 (ko) 이동 단말기 및 이동 단말기를 구비한 전자장치
KR20160031305A (ko) 이동 단말기 및 그 제어 방법
KR20180028211A (ko) 헤드 마운티드 디스플레이 및 그 제어 방법
KR20170099088A (ko) 전자 기기 및 그 제어방법
KR20210119590A (ko) 이동 단말기 및 이동 단말기를 구비한 전자장치
US20220291829A1 (en) Mobile terminal and electronic device having mobile terminal
KR20170001219A (ko) 이동 단말기 및 그의 잠금 해제 방법
KR101595398B1 (ko) 밴드 타입 단말기
WO2018159579A1 (fr) Terminal d'affichage/d'opération et système de séparation d'affichage/d'opération utilisant ledit terminal
CN111418197A (zh) 移动终端以及其控制方法

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 18761014

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 18761014

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: JP