RU2575879C2 - Display device, display control method, portable terminal and programme - Google Patents

Abstract

FIELD: radio engineering, communication.

SUBSTANCE: disclosed is a television receiver, which comprises: a display unit which displays a predetermined image on a screen, a communication unit which performs communication of image data with another display device, an indicator unit situated on at least a part of components surrounding the display unit and having an indicator which is turned on with predetermined luminance, and a control unit which turns on the indicator in accordance with an operation for transmitting the image data in another display device.

EFFECT: displaying different device states within a region of limited size.

14 cl, 47 dwg

Description

FIELD OF THE INVENTION

The proposed technology relates to a display device, a method for controlling a display and a portable terminal and a program, and in particular, to a display device, a method for controlling a display and a portable terminal and a program for presenting various states of a device within a region of limited dimensions.

State of the art

In recent years, television receivers have been gradually reducing the width of part of the frame next to the display panel representing the image (narrowing of the frame). In known devices, the photodetector section of the remote control system, an indicator (light) indicating the state of the power on, standby mode and other similar states, control buttons for setting operations of the main device and other similar components are located on this part of the frame (see, for example, Patent literature 1).

Bibliography

Patent Literature

PTL 1: Publication of Unexamined Japanese Patent Application No. 2005-267897

SUMMARY OF THE INVENTION

Technical problem

However, due to the narrowing of the considered part of the frame, the size of the area for the location of the indicator indicating the operation or status of the display device is limited, as a result of which there is a need to create a new way of representing the working or other similar state of the display device.

The proposed technology was developed taking into account these circumstances and allows you to represent the various states of the device within an area of limited size.

Solution

According to a first aspect of the present technology, there is provided a display device comprising: a display module presenting a predetermined image on a screen; a communication module exchanging image data with another display device for presenting an image (hereinafter, the display device); an indicator module located at least on a part of the components surrounding the display module and having an indicator that is turned on with a predetermined brightness; and a control module including an indicator in accordance with the transmission of image data in another display device.

According to a first aspect of the present technology, there is provided a display control method for use in a display device comprising a display module presenting a predetermined image on a screen, a communication module exchanging image data with another display device, an indicator module located at least on a portion of the components surrounding the display module, and having an indicator that turns on with a given brightness; and a control unit that controls the turning on of the indicator, the method comprises an operation when the control unit turns on the indicator in accordance with the transmission of image data in another display device.

According to a first aspect of the present technology, there is provided a program in which a computer controlling a display device turns on an indicator in accordance with an image data transmission operation in another display device, wherein the display device in question comprises a display module presenting a predetermined image on a screen; a communication module exchanging image data with another display device; and an indicator module located at least on a part of the components surrounding the display module, and having an indicator that is turned on with a given brightness.

According to the first aspect of the proposed technology, the indicator is controlled to turn it on in accordance with the operation of transmitting image data in another display device.

According to a second aspect of the present technology, there is provided a portable terminal comprising: a communication module for transmitting and exchanging image data in a display device; a display module presenting on the screen a command image for initiating the transmission of image data; and a control module that changes the on state of the indicator of the display device in accordance with the user-performed operation of transmitting image data based on the command image.

According to a second aspect of the present technology, the on state of the indicator of the display device is controlled to change this state in accordance with a user-transmitted data transfer operation based on the command image in order to instruct the transmission of image data presented on the display module screen.

According to a third aspect of the present technology, there is provided a display device comprising: a display module presenting a predetermined image on a screen; a communication module exchanging image data with another display device; an indicator module located at least on a part of the components surrounding the display module and having an indicator that is turned on with a predetermined brightness; and a control module including an indicator during the exchange of image data with another display device, so that in this display device, the control module only includes an indicator in the indicator module for a predetermined period before or after the indicator of the other display device is turned on only temporarily given period.

According to a third aspect of the present technology, there is provided a display control method for use in a display device comprising a display module presenting a predetermined image on a screen, a communication module exchanging image data with another display device, an indicator module located at least on a portion of the components surrounding the display module, and having an indicator that turns on with a given brightness; and a control module that includes an indicator during the exchange of image data with another display device, the method in question comprises an operation in which the control module only includes an indicator in the indicator module for a predetermined period before or after the indicator of the other display device included only for the duration of the specified period.

According to a third aspect of the present technology, a program is proposed in which the computer controlling the display device turns on the indicator as part of the indicator module only for a predetermined period of time before or after the indicator of another display device is turned on only for the duration of the specified period in the process exchanging image data with another display device, where the display device in question comprises a display module representing on the screen a predetermined appearance; a communication module exchanging image data with another display device; and an indicator module located at least on a part of the components surrounding the display module, and having an indicator that is turned on with a given brightness.

According to the third aspect of the present technology, the control is carried out in such a way that the indicator in the indicator module is turned on only for a predetermined period of time before or after the indicator of the other display device is turned on only for the duration of the specified period in the process of exchanging image data with another display device .

The display device in question may be a stand-alone device, or may be an internal unit in a single device.

Advantages of the Invention

According to aspects of the proposed technology, first to third, it is possible to present various states of the device within a region of limited size.

Brief Description of the Drawings

Figure 1 shows a perspective view of a television receiver as one embodiment of a display device to which the present technology is applicable.

2 is a diagram illustrating a configuration of an intelligent module LED.

3 is a diagram illustrating a configuration of an intelligent module LED.

4 shows a block diagram of a television receiver control system.

5 shows a more detailed functional block diagram of a control section of a television receiver.

6 is a diagram illustrating a basic example of turning on an LED indicator.

7 shows a diagram illustrating a basic example of turning on the LED indicator LED.

8 is a diagram illustrating a basic example of turning on an LED indicator.

Fig.9 shows a diagram illustrating a basic example of the inclusion of an LED indicator LED.

10 is a diagram illustrating an example of a sequence for turning on an LED indicator.

11 shows a diagram illustrating an example of turning on the LED indicator LED in conjunction with a video display.

12 is a diagram illustrating an example of a power-on view corresponding to power on and off operations.

13 is a diagram illustrating an example of a presentation of turning on the LED indicator LED when a predetermined button is pressed.

14 shows a diagram illustrating an example of a setting screen when a timer is set.

15 is a diagram illustrating an example of a joint presentation when a timer setting operation is performed.

16 shows a diagram illustrating the operation of a television receiver during operations with a button on a display screen.

17 shows a diagram illustrating colors when the LED indicator is on.

Fig. 18 is a diagram illustrating an example of a joint inclusion representation corresponding to an up key operation.

Fig. 19 shows a diagram illustrating an example of a joint inclusion representation corresponding to a down key operation.

20 is a diagram illustrating an example of a joint inclusion representation corresponding to a drag-and-drop operation.

21 is a diagram illustrating an example of a joint inclusion representation corresponding to a drag-and-drop operation.

FIG. 22 shows a diagram illustrating an example of a joint inclusion representation in performing an image erasing operation.

23 is a diagram illustrating an example of transitions from screen to screen when using the video chat function.

24 shows a diagram illustrating an example of a joint presentation of inclusion in an electronic point of sale (POP) terminal.

25 is a diagram illustrating an example of representing information of an LED indicator corresponding to an on position.

Fig. 26 is a diagram illustrating an example of presenting information of an LED indicator corresponding to an on position.

Fig. 27 is a diagram illustrating an example of presenting information of an LED indicator corresponding to a switching cycle.

28 is a diagram illustrating an example of representing information of an LED indicator corresponding to a switching color.

29 is a diagram illustrating an example of a joint view corresponding to a touch operation of an intelligent module.

30 is a diagram illustrating an example of a joint view corresponding to a touch operation of an intelligent module.

Fig. 31 is a diagram illustrating an example of a joint view corresponding to an operation of approximating an NFC near field communication device to an intelligent module.

32 is a diagram illustrating an example of a joint view corresponding to an operation of approximating an NFC near field communication device to an intelligent module.

33 is a diagram illustrating an example of a joint representation corresponding to data transmission.

34 is a diagram illustrating an example of a joint view corresponding to a gesture operation.

Fig. 35 is a diagram illustrating an example of a joint representation corresponding to a connection establishment operation between two Bluetooth devices (BT).

Fig. 36 is a diagram illustrating an example of collaborative presentation when working with Wi-Fi devices.

Fig. 37 shows a diagram illustrating an example of collaborative presentation when working with Wi-Fi devices.

38 is a diagram illustrating an example of a collaborative presentation when working with Wi-Fi devices.

Fig. 39 shows a diagram illustrating an example of a joint presentation when working with Wi-Fi devices.

40 shows a diagram illustrating an example of a collaborative presentation when working with Wi-Fi devices.

Fig. 41 shows a diagram illustrating an example of collaborative presentation when working with Wi-Fi devices.

Fig. 42 shows a diagram illustrating an example of collaborative presentation when working with Wi-Fi devices.

Fig. 43 shows a diagram illustrating an example of collaborative presentation when working with Wi-Fi devices.

Fig. 44 shows a diagram illustrating an example of collaborative presentation when working with Wi-Fi devices.

Fig. 45 is a diagram illustrating an example of a collaborative presentation when working with Wi-Fi devices.

Fig. 46 is a diagram illustrating an example of collaborative presentation when working with Wi-Fi devices.

47 is a diagram illustrating a process for implementing a joint presentation.

DETAILED DESCRIPTION OF THE INVENTION

Next will be described options for the proposed technology. In addition, a description will be given in the following order.

1. Example of an external configuration of a display device

2. Block diagram of the control system

3. A basic example of turning on the LED indicator LED

4. An example of the sequence of turning on the LED indicator LED

5. An example of inclusion in interaction with a video display

6. Presentation of the inclusion of the LED indicator LED in accordance with the operations of the television receiver

7. Joint representation of the inclusion when performing the image erase operation

8. Interaction between video chat screen and LED

9. Presentation of LED information based on visual image perception

10. Joint presentation corresponding to the operation performed by the user on the smart module

11. Logic for implementing collaborative presentation

[one. An example of the external configuration of the display device]

FIG. 1 illustrates an example of an outdoor configuration of a television receiver as one embodiment of a display device to which the proposed technology is applicable.

The television receiver (hereinafter referred to as TV) 1, shown in FIG. 1, comprises a main unit 11 with a display, an intelligent module 12 and a rack 13. The main unit 11 with a display contains a display 14 representing a predetermined image on the screen, such as an image of a received broadcast program , and a frame section 15 located around the display.

The specified intelligent module 12 is an indicator module containing at least a light emitting diode (LED) indicator 84 (Figure 4) as a switchable section, which represents the operation or status of the receiver TV 1 through the glow. On the front surface of the smart module 12 is a video camera 93.

In addition, the smart module 12 is located on the frame section 15 on the lower side of the main unit 11 with the display shown in FIG. 1, however, such an intelligent module 12 can be located on the frame section 15 on either the upper, left or right side of the main unit 11 with a display. In other words, this smart module 12 may be located at least in any area adjacent to the display 14.

The configuration of the LED 84 of the intelligent module 12 will be described with reference to FIGS. 2 and 3.

Figure 2 is an enlarged side view of the area adjacent to the smart module 12 for illustrating the LED 84 as part of this smart module 12, Fig. 3A is a front view of the smart module 12 and Fig. 3B is a diagram illustrating the arrangement of components of the LED 84 when looking at the intelligent module 12 from above. In addition, in FIGS. 2 and 3, the real scale of the smart module 12, the location of the corresponding parts of this smart module 12, and other similar characteristics are changed to better understand the proposed description.

The LED 84 includes, as shown in FIG. 3B, one white LED 21W and two color LEDs 21L and 21R. The white LED 21W is located in the center of the smart module 12 in the horizontal direction and is shifted slightly forward in the forward-backward direction. The color LED 21L is located behind and to the left of the white LED 21W, and the color LED 21R is located behind and to the right of the white LED 21W. The white LED 21W is implemented as a single white LED emitting white light. The color LEDs 21L and 21R are each formed by three LEDs, such as red (R), green (G) and blue (B), and can emit light of predetermined colors.

The light from the white LED 21W exits the output section 23 (Fig. 3A) on the front side of the smart module 12, which enters through a light guide plate (not shown). The light from the color LED 21L and the color LED 21L exits the output section 23 (FIG. 3A) on the front side of the smart module 12 and the output section 23 (not shown) on the output section 23 (not shown) on the bottom side of the smart module 12, where it enters through a light guide plate (not shown).

As shown in FIG. 2, around the bottom of the smart module 12, an electrode pad, which is part of the sensor 85 (Fig. 4), and a film antenna 22, including a near field communication antenna (NFC), are hidden in the thickness of the material. Accordingly, as will be described later, it is possible to detect contact or proximity (approaching a distance within a few tens of millimeters) of a user's hand, finger or other similar object, as well as a device for communicating NFC to smart module 12.

In the following description, the white LED 21W, the color LED 21L, and the color LED 21R are also referred to simply as LED 21W, LED 21L and LED 21R. In addition, when it is not necessary to distinguish between LED 21W, LED 21L and LED 21R from one another, they are also referred to simply as LED 21s.

[2. Control system block diagram]

Figure 4 shows a block diagram of a control system for a television receiver TV 1.

First, the configuration of the main unit 11 with the display as part of the TV 1 receiver will be described.

A power supply section 51 connected to an external alternating current source converts the received alternating current energy into direct current energy with a predetermined voltage supplied to the direct current converter 52. This DC / DC converter 52 converts the first supply voltage coming from the power supply section 51 into a second supply voltage, then directed to corresponding components, such as a display panel driver section 53, a control section 66, and an intelligent module 12. In addition, the supply voltage coming to different components can be the same or different.

The display panel driver section 53 controls the operation of the display panel 54 and the backlight source 55 based on the image signal from the control section 66 to present the image on the display screen. The display panel 54 and the backlight source 55 correspond to the display 14 shown in FIG. The display panel 54 controls the aperture of the liquid crystal in each pixel based on a driver control signal from the driver section 53 of the display panel.

The backlight source 55 emits light of a predetermined brightness based on a driver control signal coming from the driver section 53 of the display panel. In other words, the display 14 shown in FIG. 1 is a liquid crystal display (LCD), and the backlight source 55 is located on the rear side of the display panel 54.

Each of the HDMI connectors 55i through 55z transmits and receives a signal from a high-definition multimedia interface (HDMI) to and from an external device to which each connector is connected. The HDMI switch 56 properly switches the HDMI connectors 55i to 55z based on the control signal, and thereby relays the HDMI signal transmitted and received between external devices connected to the HDMI connectors 55i to 55z to the control section 66.

The analog audio-video (AV) input connector 57 receives an analog audio and video (AV) signal from an external device and transmits this signal to the control section 66.

The input 58 from a personal computer (PC) is formed, for example, by a 15-pin mini D-Sub connector and receives an analog image signal from a plurality of AV signals coming from a personal computer, and transmits this signal to the control section 66.

The analog audio output connector 59 transmits an analog audio signal from the control section 66 to an external device that is the destination of the connection. The optical digital audio output connector 60 transmits a corresponding optical digital signal received from the control section 66 to the external device that is the destination of the connection.

The network connector 61 of a local area network (LAN) is, for example, a connector according to the 10 BASE-T / 100 BASE-TX standard, connected to a predetermined communication network, such as a home communications network or the Internet.

The tuner 62 is connected to an antenna (not shown) through the antenna terminal 63 and extracts the broadcast signal of a given channel from the set of radio signals received by the antenna for transmission to control section 66. In addition, in the present embodiment, it is assumed that the radio waves received by tuner 62 are, for example, a broadcast signal transmitted in a terrestrial digital broadcast network.

The B-CAS card (registered trademark) 65, on which the encryption key for descrambling the digital terrestrial broadcast signal is stored, is inserted into the interface slot 64 for the CAS card. The CAS card interface 64 reads the encryption key stored on the B-CAS card (registered trademark) to transmit this encryption key to the control section 66.

The control section 66 controls the operation of the entire television receiver TV 1 based on a control program stored in the internal memory 66A comprising a read-only memory (ROM) and other similar components. The control section 66 performs, for example, analog-to-digital conversion or digital-to-analog conversion of an image signal or an audio signal, descrambling and decoding a broadcast signal, and other similar processes. In addition, the control section 66 also controls on the basis of the brightness signal, infrared (IR) signal, the signal from the sensor sensor, and the signal received from the USB module 12, described later, or the control signal LEDs as part of the LED indicator LED 84. The control section 66 may be in the form of a “system on a chip” (system on a chip (SoC)), where a central processing unit (CPU), microprocessor (MPU), random access memory (DRAM), and others like s components are integrated into a single chip.

The control program stored in the internal memory 66A may be installed via a USB memory or a hard disk drive connected to an input USB port 90, which will be described later, or via a cable or wireless communication line, such as a home communication network or the internet.

The audio amplifier 67 amplifies the analog audio signal coming from the control section 66 to transmit the amplified signal to the speaker 68. This speaker reproduces the sound corresponding to the analog audio signal from the audio amplifier 67.

Next, we will consider the configuration of the intelligent module 12 from the composition of the receiver TV 1.

The voltage from the main unit 11 with the display is supplied to the corresponding components of the smart module 12 through the relay section 81. In addition, between the main unit 11 with the display and the control section 66 of the smart module 12, a brightness signal, infrared (IR) is transmitted and received through this relay section 81 ) a signal, a signal for controlling LEDs, a signal from a sensor and a signal from a USB interface, which will be described later.

The brightness sensor 82 determines the brightness of the illumination around the TV 1 receiver (for example, the brightness in the room where this TV 1 receiver is located) and transmits the result of this determination to the control section 66 as a brightness signal.

The infrared receiver section 83 receives, for example, the infrared signal emitted by the remote control and the corresponding user operation when the user acts on the remote control (not shown) and transmits this infrared signal to the control section 66.

The LED 84 turns the LEDs on or off based on the control signal of the LEDs from the control section 66.

The specified sensor 85 contains, for example, several electrodes, the capacitance of which varies in accordance with the proximity of the finger of a person or other similar object. This sensor 85 determines a proximity operation and a user contact operation based on changes in capacitances of several electrodes and transmits the result of such determination to the control section 66 as a sensor signal.

The USB control section 86 is connected to the relay section 81, the Wi-Fi communication section 87 (Wireless Fidelity), the near field communication section 88 (NFC), the Bluetooth communication section 89 (registered trademark; BT), USB input ports (universal serial bus) 90 and 91 and coding module 92.

The USB control section 86 receives a USB interface signal corresponding to the USB standard and comes from each section - Wi-Fi communication section 87, near-field communication section 88 (NFC), BT communication section 89, USB input port 90, USB input port 91 and encoding module 92, and transmits the received signal to control section 66. In addition, the USB control section 86 appropriately distributes the USB interface signal received from the control section 66 via the relay section 81 to the Wi-Fi communication section 87, the near field communication section 88 (NFC), the BT communication section 89, to the USB input port 90, USB input port 91, or encoding module 92.

The Wi-Fi communication section 87 transmits data received from the USB control section 86 as a USB interface signal to other communication devices, such as a mobile phone, via radio communication, such as Wi-Fi communication. In addition, the Wi-Fi communication section 87 receives data transmitted by other communication devices (Wi-Fi devices) via the Wi-Fi radio and transmits this data to the USB control section 86 as a USB interface signal.

Near Field Communication Section 88 (NFC) transmits data from the USB control section 86 as a USB interface signal to other communication devices (NFC devices), such as a mobile phone, by means of near field communication according to the NFC definition in ISO / IEC 18092. In addition, the near field communication section 88 (NFC) receives data transmitted by other near field communication devices and transmits this data to the USB control section 86 as a USB interface signal.

The BT communication section 89 transmits data received from the USB control section 86 as a USB interface signal to other communication devices, such as a mobile phone, via radio (BT communication) using the Bluetooth standard (registered trademark). In addition, the BT communication section 89 receives data transmitted by other communication devices (BT devices) via the BT communication, and transmits this data to the USB control section 86 as a USB interface signal.

The USB input port 90 and USB input port 91 are connectors to which USB mating connectors of other devices are connected. For example, a USB memory or a hard disk drive-based memory device may be attached to such a USB input port 90 or USB input port 91. The specified USB input port 90 and USB input port 91 are located on opposite sides of the device, for example, on both side surfaces of the housing of the smart module 12.

The encoding module 92 is connected to the video camera 93 and the microphone 94. The video camera 93 is formed by an image pickup element, such as a charge coupler (CCD) image sensor or based on complementary metal-oxide-semiconductor (CMOS) structures ), and transmits the image signal obtained by reading the image to the encoding module 92. The microphone 94 transmits to the encoding module 92 an audio signal obtained by receiving sounds. The encoding module 92 performs signal conversion, such as analog-to-digital conversion and encoding of the image signal and the audio signal, and transmits the processed signal to the USB control section 86 as a USB interface signal.

Figure 5 shows a more detailed functional block diagram of the control section 66.

The control section 66 executes a control program stored in the internal memory 66A, and thereby implements at least an audio and video (AV) signal processing section 101, a communication control section 102, an LED control section 103 and a sensor control section 104.

The AV signal processing section 101 carries out a control procedure for presenting a predetermined image on the display 14. For example, section 101 carries out input and output procedures, analog-to-digital conversion and digital-to-analog conversion of the image signal and the audio signal, the descrambling procedure of the broadcast signal, the decoding procedure, and other similar processes.

The communication control section 102 controls communication with a communication network connected via a network connector 61 for a LAN, Wi-Fi communication, Near Field Communication (NFC), BT (Bluetooth (registered trademark)) communication and other similar communications.

The LED control section 103 controls the LEDs of the LED 84. In particular, the LED control section 103 controls the current supplied to the LEDs by pulse width modulation (PWM) to control the brightness of the radiation. The method of pulse width modulation (PWM) consists in switching on-off and on, the current in such a way that the ratio (duty ratio) of the durations of the on and off-state periods changes, which leads to the regulation of the average current value.

The sensor control section 104 receives a luminance signal from the luminance sensor 82, an infrared signal from the infrared receiver section 83, an image signal read by the video camera 93, or other similar signal and controls in accordance with the received signal. This sensor control section 104 also controls the AV signal processing section 101, the communication control section 102 and the LED control section 103 in accordance with the received signal.

In a television receiver TV 1 configured as described above, the backlight (presentation using light) in order to allow the user to intuitively recognize the operation or condition of the receiver TV 1 or the operation performed on the receiver TV 1 by the user, is performed through the interaction between the image on the display screen 14 and the inclusion of the LED indicator LED 84 as part of the intelligent module 12. In the following, a description will be given of various options for representations performed using the image shown on the display screen, and the inclusion of the LED 84 as part of the intelligent module 12.

[3. Basic example of turning on the LED indicator 84]

First, a description will be given of the simplest way to turn on the LED 84 as part of the intelligent module 12.

Fig. 6A shows an example of the appearance of the display for the case when only the central LED 21W as part of the LED 84 is turned on, and Fig. 6B illustrates an example of the appearance of the display for the case when all three LEDs 21 are lit with white light.

In addition, in FIG. 6 and in the following drawings, for a better understanding of the performance realized by turning on the LEDs, the components making up the smart module 12 are omitted, and the illustration of turning the LED indicator 84 on or off of the smart module 12 is illustrated by applying a predetermined suitable optical density. In addition, in the following description, turning the LED 84 on or off is also referred to as turning the smart module 12 on or off.

As described with reference to FIG. 2, the light from the LED 21W only comes out from the front side of the smart module 12 (from the output section 23 on this side). Therefore, when only the LED 21W is turned on, as shown in FIG. 6A, strip-shaped light emits only the front surface of the smart module 12.

The light from the LED 21L and the LED 21R comes out from the front side and the bottom side of the smart module 12 (from the output section 23 on these sides). Therefore, in a situation where all three LEDs LED 21 are turned on, as shown in FIG. 6B, a hemispherical light field is formed in a vertical direction downward from the smart module 12 in addition to the light emitted from the front surface of the smart module 12.

7 illustrates the arrangement of the three LEDs LED 21 when viewed from the top of the smart module 12, and an example of turning on the front side of the smart module 12.

When only one LED 21W is turned on, this LED 21W is located on the central front side of the smart module 12, whereby only the central region of the rectilinear smart module 12 emits dot-shaped light, as shown on the left side of FIG. 7.

On the other hand, when both LEDs 21L and 21R, located on the back side of the left and right, are turned on together with the central LED 21W, the smart module 12 emits light in the form of a rectilinear strip, as shown on the right side of FIG. 7.

As noted above, the LED 84 uses two types of radiation states, including a point view and a linear view, separately, as a result of which, for example, different states, such as the power-on state and the standby state, of the television receiver TV 1 can be represented.

When two types of radiation states are represented, including a point representation and a linear representation, the user can recognize the difference between the two types of states of the TV 1 receiver, even if the colors do not differ. In an embodiment with this representation, two color LEDs 21L and 21R can be turned on in white, so the present view can be implemented even if the two color LEDs 21L and 21R are white LEDs.

In addition to this, in the present embodiment, the LED 84 is formed by three LEDs 21, but, for example, as shown in FIG. 8, two types of radiation states, including point representation and linear representation, can even be represented using only two LEDs LED 21 located on the front and back sides. Moreover, as shown in FIG. 9, two types of radiation states, including a point view and a linear view, can be represented even in a situation where three LEDs 21 are arranged in a horizontal direction.

In other words, in this embodiment, the LED 84 is formed by one LED 21 located in the center of the front side and two LEDs 21 located on the left and right on the back side, but, in general, the number of LEDs 21 forming the LED indicator LED 84 may be equal to two or more, and the location of these LEDs LED 21 can also be determined appropriately.

In addition, for convenience of description, FIGS. 6-9 show that no light is emitted from both ends of the smart module 12, however, in practice, the LED 84 can emit light from both ends of the smart module 12.

[four. An example of the sequence of turning on the LED indicator 84]

The example described with reference to Fig.6-9, is an example of inclusion for the case when one or more LEDs 21 are turned on and off at a given radiation brightness.

Figure 10 illustrates an example of switching on when the emission brightness of one or more LEDs LED 21 smoothly changes by pulse width modulation (PWM).

If the LED control section 103 first turns on the white LED 21W in the center of the front side, then smoothly reduces the brightness of this LED and also smoothly turns on the color LEDs 21L and 21R on the back side of the left and right with white light, and then reduces the brightness, it is possible to realize the inclusion representation shown in FIG. 10A. In other words, it becomes possible to present an inclusion in which the central part of the strip-shaped (linear) intelligent module 12 emits light, the light moving and “flowing” in the horizontal direction.

In addition, when controlling in the sequence inverse to the switching control sequence shown in FIG. 10A, the switching representation shown in FIG. 10B becomes possible. In other words, it becomes possible to represent the inclusion, according to which both ends of the strip-shaped (linear) intelligent module 12 emit light, so that this light moves and “flows” towards the center.

Such a turn-on view to change the position and turn-on brightness over time can be used as a view to indicate the continuous operation of the TV 1 receiver. For example, the turn-on view can be a view indicating a specific operation when the TV 1 is connected to an external device, such as a remote control, personal computer (PC) or mobile phone (smartphone). In the case of the inclusion representation shown in Fig. 10A, the user can recognize an operation during which data is output (transmitted) from the TV 1 receiver to an external device using the smart module 12 as the base section or input / output section of the TV 1 receiver. In the case of implementing the inclusion representation shown in FIG. 10B, the user can recognize the operation of entering data into the TV 1 from an external device.

[5. An example of inclusion in conjunction with a video display]

11 illustrates an example of a joint inclusion representation in which the image representation on the display screen 14 is further combined with the inclusion representation of the LED 84 shown in FIG. 10. In addition, in FIG. 11, for a better understanding of the inclusion representation of the smart module 12, the width of this smart module 12 is depicted as the width of the main unit 11 with the display.

11A illustrates an example of a turn-on representation, according to which the inclusion of a single white LED 21 W is combined with an image representation on the display screen 14, and an example of a turn-on representation allowing the user to recognize data output in the same manner as shown in FIG. 10A.

As shown in FIG. 11A, an image first appears on the display screen 14 in which white light is located in the center of the screen. In addition, the light spot presented in the center of the screen smoothly moves down the screen to the smart module 12. Further, if the light on the display screen 14 disappears, the white LED 21W in the smart module 12 turns on and off.

FIG. 11B illustrates an example of a turn-on representation in which the inclusion of a single white LED 21W is combined with an image display on the display screen 14, and an example of a turn-on representation allowing the user to recognize input data in the same manner as shown in FIG. 10B.

As shown in FIG. 11B, the white LED 21W located in the center of the smart module 12 is first turned on and then turned off. Together with the white LED 21W turned off, an image appears on the display 14, around which there is white light around the smart module 12. In addition, an image appears on the display screen 14 in which white light is presented on the display screen, moving smoothly across the screen in an upward direction and disappearing in the center of the screen.

11C illustrates an example of an on-view representation in which the inclusion of three LEDs LED 21 is combined with an image representation on the display screen 14, and an example of an on-view view allowing the user to recognize a data output.

As shown in FIG. 11C, first an image appears in the display screen 14 in which white light is located in the center of the screen, and this light spot, presented in the center of the screen, smoothly moves down the screen towards the smart module 12. In addition, together with the disappearance of the light spot on the screen of the display 14, a turn-on representation is performed, in which the white LED 21W is turned on, located in the center of the smart module 12, after which the light in the center of the smart module 12 moves and “flows” to the left and to the right.

11D illustrates an example of an inclusion representation in which the inclusion of three LEDs 21 is combined with an image representation on the display screen 14, and an example of an inclusion representation allowing the user to recognize data input.

As shown in FIG. 11D, the color LEDs 21L and 21R at both ends of the smart module 12 are first turned on and then turned off by white light. Together with turning off the color LEDs, the LEDs 21L and 21R smoothly turn on and then turn off the white LED 21W. Accordingly, it becomes possible to present an inclusion in which both ends of the intelligent module 12 emit light, this light moving and “flowing” to the central part in the same manner as shown in in Fig. 10B. In addition, along with turning off the white LED 21W, an image appears on the display 14, in which there is white light around the smart module 12 on the screen. In addition, an image appears on the display screen 14, in which a spot of white light is presented on the display screen, moving smoothly on the screen in the upward direction and disappearing in the center of the screen.

As noted above, the inclusion representation by the LED 84 is combined with the image on the display screen in which white light is absorbed by the intelligent module 12 or emanates from this intelligent module 12, which allows the user to recognize data input and data output.

[6. Presentation of turning on the LED 84 according to the operations of the television receiver]

Next, we will consider the presentation of the inclusion of the LED indicator LED 84, corresponding to the operation with a television receiver TV 1.

[6.1 Power On and Off Operations]

12 illustrates an example of representations of starting a start operation transitioning from a standby state (power off) to a start state (power on), and a transition to a standby operation from a start state to a standby state in the TV receiver 1.

When the TV receiver 1 is in the standby state, the LED control section 103 controls the color LEDs 21L and 21R so that they emit light with a brightness of 50% of maximum brightness (MAX), for example, as shown in Fig. 12A. In addition, in the following description, for example, controlling LEDs to emit light with a brightness of 50% of the maximum brightness will be referred to as an on or similar operation at a brightness of 50%.

In addition, to perform a start operation in order to turn on the TV 1 receiver from the standby state to the start state, the user presses a power button or other similar button on the remote control. In response to such a user operation, the LED control section 103 turns on the color LEDs 21L and 21R at a brightness of 100%, as shown in FIG. 12B. In addition, at this moment, a predetermined logo ("SOMY") appears on the display screen 14.

12C illustrates a brightness control sequence of three LEDs 21 when a start operation is detected. The LED control section 103 controls the LEDs so that the color LEDs 21L and 21R are turned on at a brightness of 100% and then turned off at a predetermined point in time by reducing the brightness to a brightness level of 0%. In addition, the LED control section 103 of the LEDs controls so that the white LED 21W smoothly turns on at a brightness of 0% after a predetermined time from the start operation and reaches a brightness of 50% at a predetermined time from the start operation.

On the other hand, if the user performs the standby operation to switch the TV 1 from the start state to the standby state, the LED control section 103 performs the LED control procedure shown in Fig. 12D. In other words, the LED control section 103 controls so that the output level of the color LEDs 21L and 21R gradually increases from a brightness of 0% to a brightness of 50%, and the output level of a white LED 21W gradually decreases from a brightness of 50% to a brightness 0%

[6.2 Button Operations]

13 illustrates a turn-on LED 84 when a predetermined button is pressed, such as a channel button or a transmission program table button on a remote control of a television receiver TV1.

In well-known television receivers, usually a light emitting diode (LED) light flashes only at the moment when a button operation is detected. In this case, if the user's line of sight deviates from the screen even slightly, the inclusion of the LED light-emitting diode LED will be skipped, so it will be difficult to recognize if a button operation has been detected.

Therefore, for example, as shown by the solid line in FIG. 13A, the LED control section 103 performs this control so that the output brightness level of the three LEDs 21 increases to a brightness level of 90% of a brightness level of 0% in the case of short-term (for example, 0 , 1 s) of pressing a button and then gradually decreased to a brightness level of 0% for a given period of time (for example, 0.9 s).

Furthermore, for example, if the initial state is a state in which light is emitted with a predetermined output brightness level (e.g., 50% brightness), as shown by the solid line in Fig. 13B, the LED control section 103 performs this control so that the output brightness level temporarily increased to maximum brightness, and then returned to the original output level.

As noted above, since the inclusion presentation is performed, which gives the user an allusion sensation by changing the brightness over time as a feedback corresponding to the user's pressing the button, the inclusion can be recognized even if the user's line of sight deviates slightly from the screen, or the inclusion is “lost” »At some point, as a result of which visibility improves.

In addition, the inclusion view, leaving the user with an allusion feel, can be realized by controlling in the reverse order of the brightness control described above, as indicated by the dashed line depicted in FIGS. 13A and 13B. In other words, the control mode indicated by the solid line in FIG. 13 is implemented in such a way that the first brightness level is first set and then the brightness is reduced to the second level below the first level, however, the opposite control mode is possible when the first brightness level is set , and then increase to a second brightness level above the first brightness level. Moreover, the value of the radiation brightness control parameter used in the above examples is just an example, so there is no need to specifically say that the possible value of the control parameter is not limited to the given numerical example and can be set to any (the same applies to other examples).

[6.3 Timer Operations]

Next, a description will be given of the presentation of the inclusion of the LED indicator LED 84, the corresponding operation of the user to implement a given function. Here, a description will be given by the example of a timer function for turning the power of the TV 1 receiver on or off at a given point in time as the specified given function.

Fig. 14 illustrates a timer setting screen in a TV receiver 1.

The setup screen contains the line “On Timer”, which is the position for “power-on” or “power-off” at the appointed time, the line “Day "(" Day "), which is a position to indicate a date, the string" Time "(" Time "), which is a position to indicate a moment in time, the string" Channel "(" Channel "), which represents a position to indicate a channel, a string “Volume”, which is a position for the volume of the sound, and other similar lines .

On this settings screen, the above positions are presented over a background image representing a blurry flickering circle of a given color on a black background, so that the center of the screen is the starting point of flicker. Here, the color, for example, orange, assigned to the timer function in advance, is used as the color of the blurry flickering circle.

The user assigns a predetermined value to each position on the screen and then presses, for example, the definition button on the remote control as an operation to fix (register) the contents of the setting. If the user has pressed the determination button, TV 1 implements a joint presentation in which the image present on the display screen 14 is combined with the inclusion of the LED 84 as part of the smart module 12, as shown in Fig. 15.

In other words, in the same manner as in the switch-on view shown in Fig. 11A, the orange light circle on the setup screen smoothly moves down the screen towards the smart module 12. In addition, the LED 84 turns on in synchronization or in deadlock with the disappearance of the orange light on the settings screen. For example, if the light circle of the setup screen disappears, the color LEDs 21L and 21R as part of the smart module 12 gradually begin to emit orange light, increasing the brightness to maximum, after which the LEDs decrease brightness and then light up with a constant brightness (for example, 20% brightness) all time.

The state in which the LED indicator 84 as part of the smart module 12 is on with a constant brightness (for example, 20% brightness) all the time, indicates that the function corresponding to the color of the emitted light is operating in the TV 1 receiver at that moment. In the example given here, since the time function is assigned an orange color, the LED 84 turns on and lights up in orange with a constant brightness, indicating that the timer function is currently working.

The situation when the smart module 12 turns on and lights up with a constant brightness (for example, 20% brightness) all the time, means that the set function works in the TV 1 receiver, and the user can confirm what kind of function is currently working by pressing the screen button display on the remote control.

Fig. 16 illustrates the operation of the TV 1 receiver when the display screen button on the remote control is pressed in a situation in which the timer function is currently operating and the user is viewing a predetermined broadcast program.

The leftmost picture in FIG. 16 illustrates a situation where the smart module 12 is turned on with a constant brightness (for example, 20% brightness) in orange, indicating that the timer function is currently operating.

If the display screen button on the remote control is pressed, the image displayed on the display screen 14 and the luminance of the smart unit 12 change over time in the order indicated by the arrows. In other words, a built-in screen appears on the display screen 14 in the image area on the upper side of the smart module 12, showing the setting contents of the currently running timer function, so that the built-in screen image is superimposed on the main image on the display and disappears after a predetermined period of time. At this moment, the size of the overlay area of the embedded screen on the image of the broadcast program, which is the image of the main screen (main image), first increases over time, and then decreases. In addition, the luminance of the luminance of the smart module 12 in orange also increases over time in synchronization with the size of the overlay area of the built-in screen on the main image, and then decreases. The built-in screen showing the contents of the setting of the timer function has the value of supporting information to complement the currently operating function (the function corresponding to the switching color of the intelligent module 12).

In addition, for example, if the television receiver TV 1 has the function of recording broadcast programs transmitted over various channels, and this receiver TV 1 is in the recording mode, the smart module 12 turns on and lights up in red during the recording operation. Further, if you press the button of the display screen on the remote control, as shown in Fig.17B, during the recording operation, in the TV 1 receiver, on the display screen over the main image, an integrated screen will be superimposed on this image, on which the name of the channel will be presented , the name of the program and the image of the broadcast program, as well as other similar information, and the smart module 12 will turn on in red and with brightness, the change of which is synchronized with changes in the superimposed and images of the built-in screen.

In addition, for example, in a state in which the user uses the video chat function via the Internet, while the video chat screen (also referred to as the video chat image) is not shown on the display, and instead only the program image occupying the entire screen is displayed on the display screen , the intelligent module 12 emits a yellow light corresponding to the video chat function. Further, if the display screen button on the remote control is pressed, as shown in FIG. 17C, the video chat screen is shown on the display screen 14 as an integrated screen, and the smart module 12 is turned on in yellow with brightness, the change of which is synchronized with the change in the image of the built-in screen superimposed on the main image.

As noted above, when the user presses the display screen button on the remote control, auxiliary information in the form of an integrated screen appears on the display screen 14, and the smart module 12 is turned on with brightness, the change of which is synchronized with the changes in the integrated screen, and in a color corresponding to the type of auxiliary information.

Accordingly, the user can understand what kind of function works in the TV 1 receiver, for which it is enough for this user to observe the state in which the intelligent module 12 is turned on in a given color. In other words, the user can intuitively recognize the operation or setting status of a given function of the television receiver TV 1. In addition, if necessary, auxiliary information of the currently operating function can be displayed on the display using the built-in screen.

[6.4 Other operations]

Next, with reference to Figs. 18-31, an example of a joint inclusion representation corresponding to other operations will be given, in which the image representation on the display screen 14 is combined with the inclusion representation of the LED 84.

In addition, in Figs. 18-21, the letter "A", located in a circle of light in the image shown on the display screen 14, denotes a predetermined function, the operation with which (operation of the "up" and "down" keys or the drag operation) performs current user.

Fig. 18 illustrates a joint view of an inclusion when an up key is pressed from a set of keys for four directions, comprising an up key, a down key, a right key, and a left key on a remote control.

In the case where the up key is pressed, the joint representation of the inclusion is carried out in such a way that the emitted light moves in the up direction corresponding to this up key. In particular, the smart module 12 is turned on first. Then, an image appears on the display screen 14 in which the light spot shown next to the smart module 12 moves upward to the center of the screen in synchronization with the state in which the light emission of the smart module 12 gradually fades until it disappears .

FIG. 19 illustrates a collaborative view of power on when the down key is pressed on the remote control.

In the case where the down key is pressed, the joint representation of the inclusion is carried out in such a way that the emitted light moves in the down direction corresponding to this down key. In particular, first, an image containing a circle of light located in the center of the screen appears on the display screen 14. In addition, on the display screen 14 there is an image in which the light spot located in the center of the screen moves downward to the smart module 12. Next, the smart module 12 is turned on and then turned off synchronously with the disappearance of the light spot on the display screen 14.

FIG. 20 illustrates a collaborative view of a turn-on when a user touches the display screen 14 with a finger and performs a drag-and-drop operation to the smart module 12 if the display 14 of the TV 1 receiver is a touch panel. In this case, the TV 1 receiver in the same way presents the image on the display screen and performs the on operation, as in the case of pressing the down button on the remote control described in Fig. 19.

Fig.21 illustrates a joint view of the inclusion in a situation where the user touches the screen of the display 14 with a finger and performs the operation of dragging the screen upward from the area next to the smart module 12 if the display 14 of the receiver TV 1 is a touch panel. In this case, the TV 1 receiver in the same way presents the image on the display screen and carries out the switching operation, as in the case of pressing the up key on the remote control described in Fig. 18.

As described above, when a predetermined tuning operation is performed on the TV 1, the joint inclusion representation is performed in such a way that the circle of light is “absorbed” by the intelligent module 12, or in such a way that the circle of light comes from the intelligent module 12. In addition, such a joint representation inclusion is not limited to the "shape of the circle", but can use any color and shape. Moreover, instead of the "circle of light", a predetermined symbol or graphic pattern, or a combination of such components, can be used.

When the smart module 12 is turned on or starts to flicker with a predetermined brightness and in a predetermined color, the user performs the predetermined operation described above and can, therefore, immediately and simply confirm the content (value) indicated by turning on or blinking of the smart module 12.

[7. Joint representation of inclusion when performing the image erase operation]

In the TV 1 receiver, the smart module 12 includes a video camera 93 capable of detecting a user located on the front side of the TV 1 receiver based on an analysis of the image read by this video camera 93. In addition, the television receiver 93 has an image erasing function that allows not to represent image on the display to save energy if a condition is detected when the user is not in front of the TV 1 receiver for a predetermined time.

Figa illustrates a joint view, according to which the presentation of the image on the screen of the display 14 is combined with the inclusion of the smart module 12 in the case when the receiver TV 1 enters the erase mode.

In the case of the transition to the image erasure mode, the control section 66 controls the presentation of the image on the screen of the display 14 so that the image to be erased is "absorbed" by the smart module 12 located on the lower side relative to the display 14, as shown in Fig.22A . In other words, in the composition of the image displayed on the screen of the display 14, the image to be erased is “absorbed” by the smart module 12, as a result of which the brightness of the radiation around the smart module 12 increases. In addition, as the image presented on the screen of the display 14 is absorbed by the smart module 12, this smart module 12 turns on and becomes brighter. In other words, the control section 66 controls the presentation of images on the display screen 14 and the inclusion of the smart module 12 so that the proportion of the screen 14 of the display 14 occupied by the image changes inversely with the radiation brightness of the smart module 12.

FIG. 22B illustrates a collaborative presentation in which the image representation on the display screen 14 is combined with the inclusion of the smart module 12 when it returns to normal mode (display mode) from the image erasure mode.

In the case of returning to normal mode, the control section 66 controls the image displayed on the display screen so that the image to be displayed on the display comes from the smart module 12, as shown in FIG. 22 B. In other words, the image is first presented on the display screen 14 with high brightness around the smart module 12, and then this image, which should be presented on the display, is expanded to full screen. As the displayed image appears on the screen of the display 14, the state of the smart module 12 changes smoothly and goes into a state with low brightness. In other words, the radiation brightness of the smart module 12 decreases inversely with the proportion of the display screen occupied by the image to be displayed on the display 14.

As noted above, the control section 66 implements a joint presentation using the display 14 and the smart module 12 in such a way that the image to be erased is “absorbed” by the smart module 12 and the image to be displayed is based on this smart module 12. Here you can allow the user to recognize the intelligent module 12 as the core of the television receiver TV 1.

[8. Interaction between video chat screen and LED 84]

23 illustrates screen-to-screen transitions when using the video chat function over the Internet in the TV 1 receiver.

If the user is viewing the broadcast program specified by that user on the screen of the television receiver TV 1, represented by image 201, then when an incoming call is received to participate in video chat from another user through a communication network such as the Internet, the TV 1 receiver turns on the smart module 12 in synchronization with sound indicating the fact of the incoming call to participate in the video chat, as shown in image 202. Here is the inclusion synchronized with the audio indication of the incoming call to participate in the video h This means that the brightness of the LED 84 changes depending on the interval or on the sound volume, indicating the fact that an incoming call has arrived to participate in video chat. As described with reference to FIG. 17C, since the color of the LED 84 LED is correlated with a given function, the user can detect an incoming call to participate in video chat by recognizing the color of the LED 84 LED turning on, even if there was no sound signal indicating the fact of arrival incoming call to participate in the video.

The user responds to an incoming call to participate in video chat by pressing a given button on the remote control or the like. Then, as images 203 and 204 show, the control section 66 in the TV 1 receiver displays a video chat screen in a joint view in which the image present on the display screen 14 is combined with the inclusion of the smart module 12, as described with reference to FIG. .22 B. In other words, the control section 66 controls the activation of the smart module 12 and the presentation of the image on the display screen 14 so that the video chat image comes from the smart module 12 on top of the image The broadcast program currently being watched.

When the user ends his participation in the video chat, as images 206 to 209 show, the control section of the TV 1 receiver 66 erases the video chat image from the joint presentation, in which the image data presented on the display screen 14 is combined with the inclusion of the smart module 12, as described with reference to Fig.22A. In other words, the control section 66 controls the inclusion of the smart module 12 and the presentation of the image on the display screen 14 so that the smart module 12 located on the lower side of the display 14 “absorbs” the video chat image.

In addition, in the video chat process, communication can only occur through voice conversation without presenting the video chat image on the display screen 14. In the voice conversation mode, when chatting is carried out only by voice, as images 210 and 211 show, the video chat image is erased, and intelligent module 12 is turned on in synchronization with the voice (sound) of the interlocutor in the chat.

In the above example, a case is described in which a video chat image is presented on top of an image of the currently viewed broadcast program. However, such a representation where the image present on the screen of the display 14 is combined with the inclusion of the smart module 12 can also be used in the case where other images are displayed or erased.

FIG. 24 illustrates an example in which a representation where an image present on the display screen 14 is combined with the inclusion of the smart module 12 is applied to advertising in a retail outlet is (POP) electronic terminal.

In addition, for example, also in the case where an individual user is recognized based on his image read by video camera 93 as part of intelligent module 12, and then this recognized user is shown and after a while erased the information screen to provide him with optimal information, can be used such a representation in which the image present on the display screen 14 is combined with the inclusion of the smart module 12. The content of the information provided the user in the information display may vary, depending not only on the identified individual user, but also on the time, date, data, weather, and other similar factors. For example, if a user is recognized on the morning of the working day, this user can be provided with information such as traffic information (traffic jams) or other similar information through the information screen, for example, a train route or a road registered in advance.

As noted above, when a second image other than the first image is superimposed on the first image currently present on the display screen 14, or this second image is erased, a joint representation can be used in which the second image is “absorbed” by the intelligent module 12 or comes from this smart module 12.

[9. Presentation of information of the LED indicator 84 based on the visual perception of the image]

Next, a description will be given of an example in which the user recognizes predetermined information (state) based on the image explaining the information presented on the display screen 14 (hereinafter, the explanatory image) and the predetermined inclusion of the LED 84 of the intelligent module 12.

[9.1 Correspondence of the inclusion position]

Next will be described, with reference to Fig, an example in which the user recognizes the set information in accordance with the explanatory image and the position of the inclusion of the LED indicator LED 84.

As described above, since the three LEDs 21 in the LED 84 are arranged in a row in the horizontal direction, each of these three LEDs is turned on individually so that the user can identify three positions, namely the left side, center and right side .

Therefore, first, as shown in the upper part of FIG. 25, the control section 66 presents explanatory images for explaining predetermined information at positions corresponding to the three LEDs 21 on the left side, center and right side of the display screen 14. In the example shown 25, an image for explaining “information A” corresponding to the left LED 21L is shown, an image for explaining “information B” corresponding to the center LED 21W, and an image for explaining “information C” corresponding to right LED 21R.

In addition, the control section 66 sequentially turns on the three LEDs 21 one after the other, when explanatory images are presented on the display screen for explaining “information A”, “information B”, and “information C” to allow the user to recognize the corresponding relationships between the information A, information B and information C and LEDs 21.

Further, as in the lower part of FIG. 25, the image displayed on the display screen 14 is changed, and as a result, the explanatory images are erased. In the example shown in the lower part of Fig. 25, the image of the mountain is shown on the display screen of the TV 1 receiver 14, but this only means that this image has nothing to do with turning on the smart module 12, and that the image itself does not mean anything.

If during the presentation of the mountain image on the display screen 14 the left LED 21L is turned on, the user observing this inclusion can recognize “information A”. If the center LED 21W turns on, the user observing this turn on can recognize “information B”. If the right LED 21R turns on, the user observing this turn on can recognize “information C”. As noted above, in the case of indication of the set information, the control section 66 turns on the LED 21 at the position corresponding to the specified information.

A specific example will be considered below. For example, it is assumed a scene in which a user participates in a video chat simultaneously with three partners. In this case, the control section 66 represents the read image of user A as “information A” as part of the explanatory image present on the display screen 14, the read image of user B as “information B” and the read image of user C as “information C” and then replaces these images on the screen of the display 14 with the image of the broadcast program. In addition, the control section 66 turns on the left LED 21L when the user A is in the call transfer state, turns on the central LED 21W when the user B is in the call transfer state, and turns on the right LED 21R when the user C is in the transfer state call. The user in front of the TV 1 receiver can easily recognize which user is in the call transfer state if the user only needs to see the on position of the LED 84.

In addition, in the above example, instead of the readable images of user A, user B and user C, an image with a text explanation such as “this position corresponds to user A” may be displayed.

FIG. 26 illustrates another example in which the user recognizes predetermined information in accordance with the on position of the LED 84.

In the example shown in FIG. 26, the control section 66 displays explanatory images in the same manner as in FIG. 25, and moves the image for explaining “information B” in a downward direction on the screen. In addition, the image for explaining “information B” disappears, and the central LED 21W corresponding to “information B” is also turned on, which allows the user to recognize the correspondence relationship between the set information and the LED 21. Accordingly, if the central LED 21W is turned on even after changing the image, the user observing the inclusion can recognize “information B”.

[9.2 Compliance with the on-cycle]

Next, with reference to Fig. 27, an example will be described in which the user recognizes the set information in accordance with the explanatory image and the on-cycle (flicker circuit) of the LED 84.

In the example shown in FIG. 27, the number of information segments in question is six, namely from “information A” to “information F”.

First, as shown at the top of FIG. 27, the control section 66 presents on the screen of the display 14 explanatory images from “information A” to “information F” and at the same time sequentially displays on the screen of the display 14 these explanatory images from “information A” to “ F "information with various flicker patterns. In addition, at this moment, the LED 21W from the composition of the LED indicator LED 84 is also turned on in such a way that the change in its brightness is synchronized with the schemes of flickering images.

Further, after changing the image on the display screen 14, the intelligent module 12 is turned on in accordance with one of the flicker patterns corresponding to the pictures from “information A” to “information F” shown in the previous explanatory images. For example, as shown in FIG. 27, suppose that the LED 21W of the smart module 12 is turned on (blinks) according to a blinking pattern corresponding to “information A”. In this case, the user can recognize the “information A”, even if an image that is not associated with this information is presented on the display screen 14.

[9.3 Color matching inclusion]

Next, with reference to FIG. 28, an example will be described in which the user recognizes the set information in accordance with the explanatory image and the color of the inclusion of the LED 84.

First, in the same manner as in the example shown in FIG. 25, the control section 66 presents explanatory images for explaining “information A”, “information B” and “information C” on the display screen 14. However, in FIG. 28, the differences between explanatory images for explaining “information A”, “information B” and “information C” are presented in different colors. For example, “information A” is represented in red, “information B” is represented in blue and “information C” is represented in green.

Further, if the images on the display screen 14 are changed in such a way that explanatory images are erased, and the LED 21L is turned on in red, as shown on the left side of FIG. 28, the user observing this inclusion can recognize “information A”.

In addition, if we take the horizontal direction of the smart module 12 as the time axis and arrange the LEDs of different colors in the direction of the time axis, then the information content and its order can also be recognized by the switching mode of the smart module 12. In the right example shown in Fig. 28 since the color LED 21L is green and the color LED 21R is red, the user can recognize “information C” and “information A” in green and red.

[10. Joint presentation corresponding to the operation performed by the user on the smart module 12]

The smart module 12 is equipped with a touch sensor 85, as described above, and therefore can detect contact or proximity of the user's hand or finger. In addition, the smart module 12 is provided with a near field communication (88) section (NFC) and a Bluetooth (BT) communication section 89, whereby it can communicate with other NFC communication devices or BT communication devices. Further, the smart module 12 is equipped with a video camera 93, whereby it can determine user operations. The TV receiver 1 can carry out a predetermined joint presentation using the LED 84 and turning on the image on the display screen 14 in order to ensure compliance with various operations performed by the user with the intelligent module 12.

[10.1 Joint view corresponding to the operation of touching the smart module 12]

Fig. 29 illustrates an example of a joint view corresponding to a touch operation of the smart module 12.

The above example shown in FIG. 16 describes a situation where the timer function is currently operating on the television set TV 1, so that in this case the smart module 12 is turned on in orange, which is a color corresponding to the timer function, and if the display screen button on the remote control is pressed, auxiliary information appears on the built-in screen.

In the example shown in FIG. 29, instead of pressing the button of the display screen, as is done in the example shown in FIG. 16, a similar joint presentation is performed when a touch operation of the smart module 12 is detected.

When the timer function is currently operating in the TV 1 receiver, the smart module 12 is turned on in orange, which is the emission color corresponding to the timer function. The user touches the smart module 12, which is turned on in orange by hand. If the operation of touching the user to the intelligent module 12 is detected, the control section 66 of the TV 1 receiver displays the integrated screen as auxiliary information, so that this integrated screen is superimposed on the main image and initiates the radiation by the intelligent module 12 (more precisely, the LED indicator LED 84 as part of this module) light, the color of which corresponds to the function in question, so that changes in radiation are synchronized with changes in the built-in screen, as shown in Phi .16.

The user can understand what kind of function works in the TV 1 receiver, only on the basis of monitoring the state in which the smart module 12 is turned on with a predetermined color. In other words, the user can intuitively recognize the operation or setting status of a given function of the TV 1 receiver. In addition, by means of a simple operation, such as touching the smart module 12, it is possible to present auxiliary information for the currently operating function by using the built-in screen and thereby calling content of this function.

FIG. 29 illustrates an example of a case where a predetermined image, such as an image of a broadcast program, is presented on the main screen in the same manner as that shown in FIG. 16 discussed above, however FIG. 30 illustrates an example of a case in which a touch operation is detected. intelligent module 12 when no image is presented on the display screen of the TV 1 receiver in the standby state.

In addition, in the same way as in this case, if a user touches the smart module 12, the TV 1 displays auxiliary information on the display screen 14 around the smart module 12 and instructs the LED 84 of the smart module 12 to emit light, the color of which corresponds to the function, synchronously with the presentation of auxiliary information on the display screen.

[10.2 Joint view corresponding to the operation of approximating a near field communication device (NFC) to the smart module 12]

Fig. 31 illustrates an example of a joint view corresponding to the operation of approximating a near field communication device (NFC) to the smart module 12.

In the example shown in FIG. 31, the user takes a portable terminal (smartphone or other similar device) 221 having a near field communication (NFC) function with his hand and brings this portable terminal, and not his hand, close to the smart module 12 .

If the TV 1 detects the proximity of the portable terminal 221 to the smart module 12, this smart module 12 performs an on operation indicating the fact of proximity detection. For example, the LED 84 is turned on synchronously or in interlock with the LED LED of the portable terminal 221.

Then, the TV receiver 1 performs a joint presentation in the same manner as in the example shown in FIG. 29. In other words, the TV 1 receiver displays an integrated screen on the display as auxiliary information, so that this screen is superimposed on the main image, and instructs the LED 84 to emit light whose color corresponds to the function being performed, and the changes are synchronized with the changes on the built-in screen, such as shown in Fig. 16.

32 illustrates an example of a case in which proximity of the portable terminal 221 to the smart module 12 is detected when the TV receiver 1 is in the standby state.

In addition, in the same manner as in this case, if the TV receiver detects the proximity of the portable terminal 221 to the smart module 12, this smart module 12 performs an on operation indicating the fact of detecting such proximity. Further, on the display screen 14 around the smart module 12, auxiliary information is presented, and the LED 84 emits light, the color of which corresponds to the function performed, in synchronization with the presentation of the auxiliary information on the display.

[10.3 Joint presentation corresponding to data transfer between the portable terminal and the TV receiver 1]

Fig. 33 illustrates an example of a collaborative presentation corresponding to data transfer between closely located portable terminal 221 and smart module 12.

33A illustrates an example of a joint presentation for the case when data is being transmitted from the portable terminal 221 to the TV receiver 1.

The user brings the portable terminal 221 close to the smart module 12 of the TV receiver 1. If the proximity of the portable terminal 221 to the smart module 12 is detected, the control section 66 of the TV 1 turns on the smart module 12 in synchronization with the LED LED of the portable terminal 221. In other words, the LED LED 84 as a part of intelligent module 12 and LED LED of portable terminal 221 emit light at the same time and turn on all the time, or repeatedly turn on off in accordance with the same flicker scheme.

Next, data transmission from the portable terminal 221 to the TV receiver 1 begins via NFC communication. The control section 66 as part of the TV 1 receiver begins to receive predetermined data from the portable terminal 221 via NFC communication.

During the data transfer operation, the control section 66 of the TV 1 receiver carries out a turn-on presentation indicating data input in combination with the LED of the portable terminal 221 turning on. More specifically, the LED of the portable terminal 221 is first turned on with a predetermined brightness. In addition, the control section 66 as part of the TV 1 receiver carries out a turn-on representation, according to which the LED 84 and the image displayed on the display screen 14 are combined with each other, as shown in FIG. 11B or in FIG. 11D, for the purpose correspond to the operation of turning off (dimming) the LED light of the LED of the portable terminal 221. Fig. 33A illustrates an example in which the receiver TV 1 implements the on-view of Fig. 11B.

33B illustrates an example of a joint presentation for a case where data is being transmitted from the television receiver TV 1 to the portable terminal 221.

33A illustrates a turn-on view when a TV receiver 1 (smart module 12 included with this receiver) and a portable terminal 221 as a near field communication device (NFC) discover a communication partner.

When data transmission from the TV 1 receiver to the portable terminal 221 begins, the control section 66 of the TV 1 receiver carries out an on view indicating data output in combination with the LED of the portable terminal 221 turning on. More specifically, the control section 66 of the TV receiver 1 is first provides an inclusion representation in which there is a combination of the operation of the LED 84 and the image on the display 14, as shown in FIG. 11A or FIG. 11C. In addition, in the portable terminal 221, the LED LED of this portable terminal 221 smoothly turns on and then off in accordance with the operation of turning off (dimming) the LED indicator 84. FIG. 33B illustrates an example in which the receiver TV 1 performs a turning on presentation as shown in Fig. 11A.

As indicated above, the TV 1 receiver performs a power-on presentation together (in synchronization or in interlock) with the display section (LED LED) of an external NFC communication partner using the LED 84, thereby indicating that such communication partner.

In addition, the TV 1 receiver, performing a joint presentation, in which the inclusion of the LED 84 in combination with the presentation of the image on the display screen, additionally cooperates with the inclusion of the LED light of the LED of an external device that is a NFC communication partner, thereby indicating data input and output operations .

[10.4 Joint representation corresponding to a gesture operation performed on the smart module 12]

The TV 1 receiver has a gesture input mode in which a predetermined command is supplied or specified information is inputted to the television receiver TV 1 through a gesture operation.

In the case where a user’s hand is detected by a gesture in the input mode or a gesture is recognized, the control section 66 of the receiver TV 1 controls such that the LED 84 is turned on as shown in FIG. 34.

In other words, the user in front of the TV 1 receiver turns his palm to this TV 1 receiver (to the video camera 93 as part of this receiver). If the user's hand is detected based on the image read by the video camera 93, the control section 66 turns on the LED 84 with the first brightness level (for example, with a brightness of 40%).

If the user makes a certain gesture set in advance, and the control section 66 of the TV 1 receiver recognizes this gesture based on the image read by the video camera 93, the brightness instantly increases from the first brightness level to the second brightness level (for example, to 100% brightness). After that, the control section 66 smoothly reduces the brightness from the second brightness level to the first level.

If the gesture is recognized again based on the image read by the camcorder 93, the control section 66 controls so that the brightness instantly increases from the first brightness level to the second brightness level and then returns to the first brightness level. On the other hand, if the user puts his hand down so that his palm, which is the recognition target, cannot be recognized, the control section 66 turns off the LED 84.

As indicated above, the control section 66 controls the LED 84 to perform an on-view that creates an allusion to the user by changing the brightness from the first brightness level to the second brightness level over time when the gesture is recognized. The implementation of this inclusion makes it easy to understand whether the side of the receiver TV 1, which receives a given command or information, receives a command from the user.

[10.5 Joint view corresponding to the operation of establishing a connection between two Bluetooth devices (BT)]

Fig. 35 illustrates an example corresponding to a connection establishment operation between two devices (BTs).

The headphones 241 shown in FIG. 35 are a BT device receiving an audio signal from a broadcast program or other similar audio signal from a TV receiver 1 via a BT connection and reproducing sounds. These earphones 241 are equipped with an LED bulb 242 emitting a predetermined light in accordance with a power state or a communication state.

As shown in FIG. 35A, before the TV 1 receiver and the headphones that are BT devices establish a connection with one another, the LED 84 of the TV 1 receiver and the LED 242 of the headphones 241 will remain off.

The user performs the operation of establishing a connection between the TV receiver 1 and the headphones 241. In other words, the user performs some operation predefined with the headphones 241, as a result of which the operation mode of the headphones is changed so that these headphones enter the connection mode. In addition, the mode of the TV 1 receiver also changes, and the receiver enters the connection mode, and the control section 66 of the TV 1 receiver extracts information about the presence of BT devices within the area where communication is possible in order to detect headphones 241.

The control section 66 of the TV 1 receiver carries out the operation of establishing a connection with the detected headphones 241. Accordingly, the TV 1 and the headphones 241 share the same password (PIN).

If the connection is completed, the TV 1 performs a joint presentation in which the inclusion of the LED 84 is combined with the image on the display screen to indicate the completion of the connection, as shown in FIG. 35B. In other words, the TV 1 receiver instructs the LED 84 to emit light at a first brightness (for example, 100% brightness), and also to present on the display screen 14 an image of a hemispherical light spot centered in the smart module 12. On top of the image shown on the display screen 14, the text “Pairing with Headphone!” Appears. The inclusion of the LED indicator LED 84 and the presentation of the image on the display screen is controlled in such a way as to ensure coincidence with the flicker pattern of the LED bulb LED 242 of the headphones 241 and synchronization of the circuits. In addition, the inclusion of the LED indicator 84 and the presentation of the image on the display screen can be implemented in such a way as to ensure interlocking with the flicker circuit of the LED light bulb LED 242 of the headphones 241, while maintaining a predetermined time difference between these circuits.

During the second and subsequent connections between the television receiver TV 1 and the headphones between which a connection has already been established, synchronous power-on control is also performed, as shown in FIG. 35B, when interconnected BT devices are detected. In addition, if the TV 1 is currently connected to the headphones 241 via the BT communication channel, the LED 84 of the smart module 12 and the LED 242 of the headphones 241 are turned on with a second brightness level (for example, 40% brightness) below the first level brightness.

[10.6 Sharing using a Wi-Fi device in a home network]

The TV receiver 1 includes an intelligent module 12 in accordance with the state of communication with other communication devices connected to the home communication network by cable or wirelessly.

The TV 1 receiver is, for example, a DLNA standard device (digital living network alliance) and can receive content from other DLNA standard devices to present an image corresponding to the received content on the display screen 14.

The operation of transmitting content (an image corresponding to the content) reproduced and displayed on the display of the first DLNA standard device from this first DLNA standard device, the second DLNA standard device, is referred to as a “cast”. On the contrary, the operation of inputting content (an image corresponding to this content) reproduced and displayed on the display screen of the second DLNA standard device into the first DLNA standard device is called “capture”, “capture”.

FIG. 36 illustrates an example of a collaborative presentation performed by the TV 1 receiver and the portable terminal 261 when content is “dropped” from the portable terminal 261, which is the first DLNA compliant device, and the TV 1 receiver, which is the second DLNA compliant device.

First, the user selects a “throw” procedure for the content that is currently being played and presented on the display of the portable terminal 261. Accordingly, as shown in FIG. 36A, the icons of the direct devices 281 and 282, which are the icons of the DLNA compliant devices and connected to home network, as candidates for the “throw” content, appeared on the display screen 262 of the portable terminal 261. In this example, it is assumed that the icon 281 “throwing” device tvuet television receiver TV 1, and the icon 282 "throwing" of the device corresponds to a personal computer (not shown) connected to the home network communication. Hereinafter, the icon of the throwing device 281 will also be referred to as the icon of the television receiver 281, and the icon of the throwing device 282 will also be called the icon of the personal computer PC 282.

The user drags the content icon 283 with a finger using the thumbnail of the content that is displayed and displayed on the display and brings this icon to the icon of the “throwing” device 281 or 282, which needs to “transfer” the content.

Assuming that the TV 1 receiver has been selected as the content throw destination, the user draws a finger by dragging the icon from the display screen 262 on the icon 281 of the TV receiver.

After the finger dragging the icon away from the TV receiver icon 281, the content icon 283 disappears, as if this content icon 283 was absorbed by the TV receiver icon 281, as shown in Fig. 36C, which ultimately leads to the state shown in Fig. 36D. When the content icon 283 is absorbed by the TV receiver icon 281 and disappears, as shown in FIG. 36C, the brightness of the LED 84 of the smart module 12 gradually increases from the first brightness level (50% brightness) to the second brightness level (100% brightness) . In addition, as shown in FIG. 36D, the LED 84 is smoothly turned off from the second brightness level, so that the image of the content played and displayed on the display of the portable terminal 261 appears on the display screen 14 of the TV 1 receiver.

Fig. 37 illustrates a state in which an image 291 of the content being played back and displayed on the display 262 of the portable terminal 261 smoothly appears on the display screen of the TV receiver 1. This image 291 of the content currently being played on the portable terminal 261 appears on the display screen of the television TV 1 in the order corresponding to the sequence of FIG. 37A, FIG. 37B, FIG. 37C, FIG. 37D of FIG. 37E.

[Various operations of "capture" and "throw"]

Next, with reference to Figs. 38-44, a description will be given of the interaction of the communication in the "capture" or "throw" mode and the joint presentation between the display 14 and the LED 84 as part of the same TV 1 receiver.

First, the home network to which the TV 1 receiver is to be connected is connected to this TV 1 receiver, a tablet terminal 301, and a portable terminal 302, referred to as a smartphone, as shown in FIG. 38.

The tablet terminal 301 includes a display 311, an LED light bulb LED 312, a control module (not shown) that controls the above items, and a radio module (not shown) that performs radio communication such as Wi-Fi, near-field communication (NFC) and BT connection. An image 313 of predetermined content is displayed on the display 311 of the tablet terminal 301. The portable terminal 302 also includes a display 321, an LED light bulb LED 322, a control module (not shown) that controls the above items, and a radio module (not shown). The display 321 of the portable terminal 302 presents an image 323 of the set content. On the display screen 14 of the TV 1 receiver, an image 331 of the contents of a given broadcast program or other similar image is presented.

If the user performs a predetermined operation configured in advance, such as “tapping” on the display screen 321 of the portable terminal 302, the command screen for performing a “catch” / “throw” shown in FIG. 39A appears on the screen of this display 321. On this screen of commands for performing a “capture” / “throw”, an icon 341 is presented for selecting a “throw” that is affected during the execution of the “throw”, and an icon 342 for selecting a “catch” that is affected during the execution of the “catch” procedure .

When it is necessary to “roll” the image 323 of the content reproduced and displayed on the display of the portable terminal 302, the user taps (selects) an icon 341 for selecting a “throw” present on the display screen 321.

If you click on the icon 341 to select a “throw” and thereby select such a “throw” (procedure), as shown in FIG. 39B, the TV icon 343 corresponding to the television receiver TV 1 and the icon will appear on the display 321 of the portable terminal 302 344 tablets corresponding to the tablet terminal 301 as candidates for the role of the “throw” target.

The user taps and selects either the icon 343 of the TV TV or the icon 344 of the tablet terminal that appears on the display of the portable terminal 302 as the “throw” destination, as a result of which the image 323 of the content played and displayed on the display of the portable terminal 302 is transmitted to the television receiver TV 1 or tablet terminal 301.

In addition, in the state in which the “throw” selection screen appears on the display 321 of the portable terminal 302, as shown in FIG. 39B, the user brings the portable terminal 302 held in his hand close to the smart module 12 of the TV 1 receiver in as the destination of the "throw", as shown in Fig. Then the TV 1 receiver and the portable terminal 302 determine the fact of mutual proximity by means of NFC communication, so that the TV 1 receiver is selected as the “throw” destination and the image 323 of the content played and displayed on the portable terminal 302 is “transferred” to the TV 1 receiver.

In the process of such a “throw”, a joint representation between the display 14 and the LED 84 of the TV 1 receiver, described with reference to FIG. 37, is carried out between the TV 1 receiver as the “throw” destination and the portable terminal 302.

On the other hand, on the “catch” / “throw” command screen shown in FIG. 39A, also when tapping the icon 342 to select “capture” and thereby select “capture” (process) on the display 321 of the portable terminal 302, a “capture” destination selection screen appears, as shown in FIG. 39B. In addition, the DLNA compliant device is designated as a “catch” target by tapping on the TV icon 343 or tablet terminal icon 344, or by approaching the portable terminal 302. As a result, an image of the content from the designated DLNA compliant device is input, and present on display 321 of portable terminal 302.

41 and 42 are diagrams illustrating another method of action for realizing mutual communication.

In the portable terminal 302, in a state where the “throw” destination selection screen shown in FIG. 39B is present on the display, the TV 1 receiver or portable terminal 302 can be designated as the “throw” destination by performing a drag-and-drop operation of the content image 323 presented on the display 321, in the upward direction in the picture and the finger is removed from the screen when this finger is on the icon 343 of the TV or on the icon 344 of the tablet device.

At this point, as shown in FIG. 41, if the content image 323A, to which the content image 323 has been reduced due to drag and drop, is overlaid on the TV icon 343, the LED 84 as part of the smart module 12 of the TV 1 receiver corresponding to icon 343 of the TV, turns on in accordance with the specified cycle. In other words, the portable terminal 302 causes the LED 84 to be turned on as part of the smart module 12 in accordance with a predetermined cycle by transmitting a control signal indicating that the TV is selected to the TV receiver 1 selected as the “throw” destination in a state where the image 323A of the content is superimposed on the icon 343 of the TV TV.

At this point, as shown in FIG. 42, if the content image 323A, to which the content image 323 has been reduced due to drag and drop, is in a state of overlapping on the tablet device icon 344, the LED light 312 of the tablet terminal 301 corresponding to the tablet device icon 301 is turned on in accordance with a given cycle. In other words, the portable terminal 302 causes the LED 84 in the smart module 12 to turn on in accordance with a predetermined cycle by transmitting a control signal indicating the fact of selecting a tablet terminal to such a tablet terminal 301 selected as the “throw” destination in a state where a content image 323A is superimposed on top of the tablet device icon 344.

As noted above, the TV 1 receiver and the tablet terminal 301 are turned on in a predetermined cycle if the TV TV and the tablet terminal are selected as destinations for outputting the content image 323 in the portable terminal 302. Accordingly, the user can easily recognize the device that is the “throw” destination ( the destination of the output of the content data).

Fig. 43 is a diagram illustrating another method for realizing communication in interaction.

In the state in which the content image 323 is displayed and displayed on the display of the portable terminal 302, as shown in FIG. 38, the user performs a drag operation on the display 321 of the portable terminal 302 in the upward direction in the picture, as shown in FIG. 43A. If a drag-and-drop operation performed by the user is detected, the portable terminal 302 recognizes that a “throw” command has been issued, and a “throw” icon 361 appears on the display screen 321 over the image indicating the “throw” operation. Then, on the display 321, the same “throw” target selection screen appears, as shown in FIG. 39B.

On the other hand, as shown in FIG. 43B, the user performs a drag operation on the display 321 of the portable terminal 302 in the downward direction of the picture. If a drag-and-drop operation performed by a user is detected, the portable terminal 302 recognizes that a “catch” command has been issued and displays a “catch” icon 362 on top of the existing image indicating the “catch” operation. Then, the same pick-up destination selection screen appears on the display 321, as shown in FIG. 39B.

The operations after the screen for selecting the “throw” destination or the “capture” address appear on the display are the same as in the example considered above, as a result of which the description of these operations will not be repeated.

Fig. 44 is a diagram illustrating another method for realizing communication in interaction.

In the state in which the image 323 of the content is reproduced and presented on the display of the portable terminal 302 shown in Fig. 38, the user brings the portable terminal 302, which he holds in his hand, close to the smart module 12 as part of the TV 1 receiver as the destination communication interactions, as shown in FIG. Then, the TV receiver 1 and the portable terminal 302 determine the mutual proximity by means of NFC communication. In addition, the LED indicator 84 as part of the intelligent module 12 of the receiver TV 1 and the LED light bulb 322 as part of the portable terminal 302 are turned on simultaneously with one another.

At the same time, portable terminal 302 displays on its display 321 the same communication interaction selection screen as shown in FIG. 39A. On the communication interaction selection screen, in the case when a “throw” selection icon 341 is tapped, the content image 323 reproduced and displayed on the display of the portable terminal 302 is “thrown” to the TV receiver 1. On the other hand, on the interaction selection screen When a tapping (selection) is made on the “catch” selection icon 342, the content image 331 displayed and displayed on the display of the TV 1 receiver is “picked up” by the portable terminal 302 from this TV 1 receiver and appears on the screen display 321 of portable terminal 302.

The two communication devices 401 (401A and 401B) shown in Figs. 45 and 46 have the same function as the above-described television receiver TV 1, tablet terminal 301 and portable terminal 302, and include LED indicators 411 (411A and 411B). )

If two communication devices 401A and 401B are placed next to each other and between these communication devices 401A and 401B, an interaction relationship such as “catching” and “throws” of content has begun, as shown in FIG. 45, first, if the device LED 411A The communication 401A and the LED 411B of the communication device 401B are blinking, the user can easily identify the favorable parts brought close to one another.

In addition, if the user places the area next to the flashing LED LED 411A of the communication device 401A and the area next to the flashing LED LED 411B of the communication device 401B close to one another, these communication device 401A and the communication device 401B mutually detect (recognize) one another as partners. If these communication device 401A and communication device 401B have found partners, each of them is turned on in the same way as its partner. For example, the LED 411A of the communication device 401A and the LED 411B of the communication device 401B flash at the same time. Accordingly, the user can easily determine that the communication device 401A and the communication device 401B are mutually recognized by each other as partners. Instead of changing the brightness of the radiation, the color of the blinking may change, or the shape of the blinking part may change.

In addition, during data transmission, as shown in FIG. 46, the LED 411A of the communication device 401A and the LED 411B of the communication device 401B are turned on so as to correspond to data movement. In other words, the control can be repeated with a step equal to the transmission of a given unit of data, so that first the LED 411A of the communication device 401A, which is the source of data transmission, is turned on with high brightness, and the LED 411B of the communication device 401B is turned on with high brightness in accordance with turning off the LED 411A. As a result, the user can intuitively recognize the transmission and reception of data between communication devices 401A and 401B. Alternatively, the LED 411A of the communication device 401A and the LED 411B of the communication device 401B can be turned on so that turning on and off is repeated at the same time.

[eleven. Logic for implementing shared view]

Fig. 47 Fig. 47 is a diagram illustrating a process for implementing the above-described joint representation between the image display on the display screen 14 and the inclusion of the LED 84 in the TV receiver 1.

During the implementation of this process, in step S1, the control section 66 of the television set TV 1 determines whether a user operation or other similar action has been detected that may serve as a trigger for a joint presentation. These user operations or other similar actions correspond to various operations or conditions of the device, such as pressing a button on a remote control, user actions such as a gesture, approaching another communication device to the smart module 12, or receiving a message requiring communication interaction.

The process in step S1 is repeatedly repeated until it is determined that a user operation has been detected, and if it is determined in step S 1 that a user operation or other similar action has been detected, the process proceeds to step S2. In addition, in step S2, the receiver control section 66 of the TV 1 carries out the joint presentation described above, in which the image on the display screen 14 is presented in conjunction with the LED 84 being turned on.

The examples described above mainly described the joint presentation performed by the TV 1 receiver, however, the proposed technology is applicable not only to television receivers, but generally to display devices, such as a portable terminal, including a smartphone, or a tablet terminal equipped with a video display module, such such as a liquid crystal display (LCD) or electroluminescent (EL) display, by an indicator (turn-on module), such as an LED indicator LED, indicating the specified operation or status according to redstvom glow.

Variants of the proposed technology are not limited to the examples described above, but may have various modifications, while remaining within the scope of the present invention and not deviating from its essence.

In addition, the proposed technology may have the following configurations.

(1) A display device comprising a display module presenting a predetermined image on a screen; a communication module exchanging image data with another display device; an indicator module located at least on a part of the components surrounding the display module and having an indicator that is turned on with a predetermined brightness; and a control module including an indicator in accordance with the operation of transmitting image data in another display device.

(2) A display device according to the above (1), wherein the indicator is turned on under the control of said control module when the display device in question is selected as a destination for transmitting image data in another display device.

(3) The display device according to the above (1) or (2), wherein the indicator is turned on under the control of the specified control module during the exchange of image data with another display device.

(4) The display device according to one of the above (1) to (3), in which the indicator is turned on in conjunction with another display device under the control of the specified control module, so that the indicator light changes in accordance with the movement of image data during exchange with another display device.

(5) The display device according to one of the above (1) to (4), in which the communication module receives image data from another display device, and in which the control module controls to display on the display screen an image corresponding to the received image data , thus, as if it comes from the indicator module, and turns on the indicator synchronously or in interlock with the representation on the display screen where this image comes from the indicator module.

(6) A display device according to one of (1) to (5) above, further comprising a near field communication module that determines that another display device is at least placed close to the indicator module and which communicates with another a display device close by the user to the display device in question as an image data transfer operation.

(7) A display control method for use in a display device comprising a display module presenting a predetermined image on a screen, a communication module exchanging image data with another display device, an indicator module located at least on a portion of the components surrounding the display module, and having an indicator that is turned on with a given brightness, and a control module that controls the inclusion of the indicator, the method comprises an operation when the control module turns on the indicator in accordance with radio by transmitting image data in another display device.

(8) A program in accordance with which a computer controlling a display device turns on an indicator according to an operation for transmitting image data in another display device, where the display device in question comprises a display module presenting a predetermined image on a screen; a communication module exchanging image data with another display device; and an indicator module located at least on a part of the components surrounding the display module, and having an indicator that is turned on with a given brightness.

(9) A portable terminal comprising a communication module for transmitting and exchanging image data with a display device; a display module presenting on the screen a command image for initiating an image data transmission operation; and a control module that changes the on state of the indicator of the display device in question in accordance with the user-performed operation of transmitting image data based on the command image.

(10) A display device comprising a display module presenting a predetermined image on a screen; a communication module exchanging image data with another display device; an indicator module located at least on a part of the components surrounding the display module and having an indicator that is turned on with a predetermined brightness; and a control module including an indicator during the exchange of image data with another display device, so that in this display device, the control module only includes an indicator in the indicator module for a predetermined period before or after the indicator of the other display device is turned on only temporarily given period.

(11) The display device according to the above (10), in which, from the combination of indicators of another display device and the display device in question, the indicator of the device that is the source of image data transmission is turned on first only for the period of the specified period, and then the indicator of the device that is the destination image data transmission is switched on only for a specified period of time.

(12) The display device according to (10) or (11) above, in which the indicator in the indicator module is turned on only for a specified period of time before or after the image is displayed on the screen of the display module, where the area next to the indicated indicator in the indicator module has a high brightness.

(13) A display device according to one of (10) to (12) above, further comprising a near field communication module that determines that another display device is at least placed close to the indicator module, and where the indicator is part of the indicator module turns on simultaneously with the indicator on another display device, when the communication module in the near field detects the proximity of another display device.

(14) A display control method for use in a display device comprising a display module presenting a predetermined image on a screen, a communication module exchanging image data with another display device, an indicator module located at least on a portion of the components surrounding the display module, and having an indicator that is turned on with a given brightness, and a control module that includes an indicator during the exchange of image data with another display device, the method in question comprises operation, in accordance with which the control module turns on the indicator in the indicator module only for a predetermined period before or after the indicator of another display device is turned on only for the duration of the specified period.

(15) The program, according to which the computer controlling the display device, turns on the indicator in the indicator module only for a predetermined period of time before or after the indicator of another display device is turned on only for the duration of the specified period in the process of exchanging image data with another display device, where the display device in question comprises a display module presenting a predetermined image on the screen; a communication module exchanging image data with another display device; and an indicator module located at least on a part of the components surrounding the display module, and having an indicator that is turned on with a given brightness.

List of Keys

1 Television receiver, 11 Main unit with display, 12 Intelligent module, 14 Display, 15 Frame section, 66 Control section, 84 LED indicator LED, 85 Touch sensor, 87 WI-FI communication section, 88 NFC communication section, 89 BT communication section , 93 Camcorder, 101 AV processing section, 102 Communication control section, 103 LED control section, 104 Video camera control section

Claims (14)

1. A display device comprising:
a display module configured to present a predetermined image on a screen;
a communication module configured to exchange image data with another display device;
an indicator module located at least on a part of the components surrounding the display module and having an indicator that is turned on with a predetermined brightness; and
a control module configured to turn on an indicator in accordance with the operation of transmitting image data in another display device,
characterized in that the control module controls to present on the display screen an image corresponding to the image data received by the communication module from another display device, as if it comes from the indicator module, and turns on the indicator synchronously or in interlock with the presentation on the display screen where this image comes from the indicator module. 2. The display device according to claim 1, characterized in that the indicator is turned on under the control of the specified control module when the display device in question is selected as the destination for transmitting image data in another display device. 3. The display device according to claim 1, characterized in that the indicator turns on under the control of the specified control module during the exchange of image data with another display device. 4. The display device according to claim 1, characterized in that the indicator is turned on in conjunction with another display device under the control of the specified control module, so that changes in the indicator light occur in accordance with the movement of image data when exchanging with another display device. 5. The display device according to claim 3, further comprising a near-field communication module configured to determine that another display device is at least placed close to the indicator module, characterized in that the communication module communicates with another display device close to the user to the display device in question for transmitting image data. 6. A display control method for use in a display device comprising a display module presenting a predetermined image on a screen, a communication module exchanging image data with another display device, an indicator module located at least on a portion of the components surrounding the display module, and having an indicator that is turned on with a predetermined brightness and a control module that controls the inclusion of the indicator, the method comprises an operation when the control module turns on the indicator in accordance with by transmitting image data in another display device, characterized in that the control module controls to display on the display screen an image corresponding to image data received by the communication module from another display device, as if it is coming from the indicator module, and turns on the indicator synchronously or in a deadlock with a representation on the display screen, where this image comes from the indicator module. 7. A computer-readable recording medium containing a program recorded on it, according to which the computer controlling the display device implements a method comprising turning on an indicator in accordance with the operation of transmitting image data in another display device, characterized in that it further controls for presentation on the display screen of the image corresponding to the image data received from another display device, as if it comes from the indicator module, and turns on The indicator is synchronized or interlocked with a representation on the display screen, where this image comes from the indicator module, while the considered display device contains
a display module configured to present a predetermined image on a screen;
a communication module configured to exchange image data with another display device;
an indicator module located at least on a part of the components surrounding the display module and having an indicator that is turned on with a predetermined brightness. 8. A portable terminal comprising:
a communication module configured to transmit and exchange image data with a display device;
a display module configured to present on the screen a command image to initiate the operation of transmitting image data; and
a control module configured to change the on state of the indicator of the display device in question in accordance with a user-performed operation of transmitting image data based on a command image,
characterized in that the control module controls to present on the display screen an image corresponding to the image data received by the communication module from another display device, as if it is coming from the indicator module, and turns on the indicator synchronously or in interlock with the presentation on the display screen where this image comes from the indicator module. 9. A display device comprising:
a display module configured to present a predetermined image on a screen;
a communication module configured to exchange image data with another display device;
an indicator module located at least on a part of the components surrounding the display module and having an indicator that is turned on with a predetermined brightness; and
a control module configured to turn on the indicator during the exchange of image data with another display device,
characterized in that the control module includes an indicator in the indicator module only for a predetermined period before or after the indicator of another display device is turned on only for the duration of the specified period, and
the fact that the control module controls to present on the display screen an image corresponding to image data received by the communication module from another display device, as if it comes from the indicator module and turns on the indicator synchronously or in interlock with the presentation on the display screen, where This image comes from the indicator module. 10. The display device according to claim 9, characterized in that from the combination of indicators of another display device and the display device in question, the indicator of the device that is the source of image data transmission is turned on first only for the period of the specified period, and then the indicator of the device that is the destination of image data transmission , included only for the time of the specified period. 11. The display device according to claim 9, characterized in that the indicator in the indicator module is turned on only for a specified period of time before or after the image is presented on the screen of the display module, where the area next to the indicator in the indicator module has a high brightness. 12. The display device according to claim 9, further comprising a near-field communication module, configured to determine that another display device is at least placed close to the indicator module, characterized in that the indicator in the indicator module is turned on simultaneously with the indicator of the other a display device when a near field communication module detects the proximity of another display device. 13. A display control method for use in a display device comprising a display module presenting a predetermined image on a screen, a communication module exchanging image data with another display device, an indicator module located at least on a portion of the components surrounding the display module, and having an indicator that is turned on with a given brightness, and a control module that includes an indicator during the exchange of image data with another display device, the method in question comprises an operation in which the control module turns on the indicator in the indicator module only for a predetermined period before or after the indicator of the other display device is turned on only for the time of the specified period, characterized in that the control module controls for presentation on the display screen image corresponding to the image data received by the communication module from another display device, as if it comes from the indicator module, and turns on the indicator s synchronously or in deadlock with the representation on the display screen, where this image comes from the indicator module. 14. A computer-readable recording medium containing a program recorded on it, according to which the computer controlling the display device, turns on the indicator as part of the indicator module only for a predetermined period of time before or after the indicator of the other display device is turned on only temporarily a predetermined period in the process of exchanging image data with another display device, characterized in that it further controls to display on the display screen the image corresponding to the image data received from another display device, as if it comes from the indicator module, and turn on the indicator synchronously or in interlock with the presentation on the display screen, where this image comes from the indicator module, while the considered display device contains
a display module configured to present a predetermined image on a screen,
a communication module configured to exchange image data with another display device, and
an indicator module located at least on a part of the components surrounding the display module and having an indicator that is turned on with a predetermined brightness.

Images