KR102172766B1 - Video display apparatus and operating method thereof - Google Patents

Abstract

The method of operating a video display device according to an embodiment of the present invention includes the step of recognizing content using an automatic content recognition technique and a questionnaire for health care service when the number of times of using the recognized content is greater than or equal to a threshold. Receiving a setting input for setting a collection period of the user's biometric information, exercise amount information, and the biometric information and exercise amount information on the displayed questionnaire, and providing the health care service based on the received setting input Includes steps.

Description

Video display device and its operation method {VIDEO DISPLAY APPARATUS AND OPERATING METHOD THEREOF}

The present invention relates to a video display device and a method of operating the same.

Along with the digital broadcasting service being provided and the development of digital technology, a technology for providing a higher quality broadcasting service is attracting attention.

In addition, users' demands for content and broadcasting services that actively reflect the user's demands along with existing broadcasting services are increasing.

However, a system for collecting user information of the current broadcasting system and processing the collected user information has not been constructed, and thus, it is difficult to provide a broadcasting service suitable for each user.

An object of the present invention is to provide a video display device and a method of operating the same to identify user characteristics through a questionnaire and provide a customized service to the user.

In addition, an object of the present invention is to provide an image display device and a method of operating the same, which provides a health management service suitable for the identified health state by grasping a user's health state.

The method of operating a video display device according to an embodiment of the present invention includes the step of recognizing content using an automatic content recognition technique and a questionnaire for health care service when the number of times of using the recognized content is greater than or equal to a threshold. Receiving a setting input for setting a collection period of the user's biometric information, exercise amount information, and the biometric information and exercise amount information on the displayed questionnaire, and providing the health care service based on the received setting input Includes steps.

The video display device according to an embodiment of the present invention recognizes content using a display unit and an automatic content recognition technique, and when the number of times of use of the recognized content is greater than a threshold, a questionnaire for health care service Control the display to display, receive a setting input for setting a collection period of the user's biometric information, exercise quantity information, and the biometric information and exercise quantity information on the displayed questionnaire, and provide the health management service based on the received setting input. It includes a control unit to provide.

According to an embodiment of the present invention, a customized service may be provided to a user by identifying user characteristics through a questionnaire.

In addition, according to an embodiment of the present invention, a health management service suitable for the determined health state may be provided by identifying a health state of a user.

In addition, according to an embodiment of the present invention, a menu for providing a service related to a content is provided through a 2nd screen instead of a screen of a video display device, thereby minimizing the inconvenience of a user's viewing experience.

1 is a block diagram showing a network topology according to an embodiment of the present invention.
2 is a block diagram showing a watermark-based network topology according to an embodiment of the present invention.
3 is a ladder diagram showing a data flow in a watermark-based network topology according to an embodiment of the present invention.
4 shows a watermark-based content recognition timing according to an embodiment of the present invention.
5 is a block diagram showing a fingerprint-based network topology according to an embodiment of the present invention.
6 is a ladder diagram illustrating a data flow in a fingerprint-based network topology according to an embodiment of the present invention.
7 shows an XML schema diagram of ACR-Resulttype containing a query result according to an embodiment of the present invention.
8 is a block diagram showing a network topology based on a watermark and a fingerprint according to an embodiment of the present invention.
9 is a ladder diagram showing data flow in a watermark and fingerprint based network topology according to an embodiment of the present invention.
10 is a block diagram of an image display device according to an embodiment of the present invention.
11 is a diagram illustrating a system according to an embodiment of the present invention.
12 is a block diagram of a wearable device according to an embodiment of the present invention.
13 is a ladder diagram illustrating a method of operating a system including a content providing server and an image display device according to an embodiment of the present invention.
14 is an embodiment of identifying a user through a plurality of icons and providing a home screen corresponding to the identified user according to an embodiment of the present invention.
15 is a diagram illustrating an XML schema table of a PDI questionnaire according to an embodiment of the present invention.
16 to 17 are diagrams for explaining an example in which a video display device displays a PDI questionnaire received from a content providing server according to an embodiment of the present invention.
18 is a diagram illustrating a process of receiving a user's response to a PDI questionnaire displayed on an image display device according to an embodiment of the present invention.
19 is an embodiment in which a video display device displays collection information received from a wearable device according to an embodiment of the present invention.
20 to 21 are diagrams for explaining an embodiment in which a video display device receives a health care service according to an embodiment of the present invention.

Hereinafter, a mobile terminal related to the present invention will be described in more detail with reference to the drawings. The suffixes "engine", "module", and "unit" for the components used in the following description are given or used interchangeably in consideration of only the ease of writing the specification, and do not have distinct meanings or roles by themselves. .

Next, a network topology according to an embodiment of the present invention will be described with reference to FIGS. 1 to 9.

1 is a block diagram showing a network topology according to an embodiment of the present invention.

As shown in FIG. 1, the network topology according to an embodiment of the present invention includes a content providing server 10, a content recognition service providing server 20, a multi-channel video distribution server 30, and an additional service information providing server ( 40), a plurality of additional service providing servers 50, a broadcast receiving device 60, a network 70, and a video display device 100.

The content providing server 10 may correspond to a broadcasting station or the like and broadcasts a broadcast signal including main audio-visual content. The broadcast signal may further include an additional service. Additional services may or may not be related to the main audio-visual content. Additional services include service information, metadata, additional data, compiled executable files, web applications, HTML (Hypertext Markup Language) documents, XML documents, cascading style sheet (CSS) documents, audio files, and videos. It may be in the form of a file, ATSC 2.0 content, and an address such as a URL (Uniform Resource Locator). One or more content providing servers may exist.

The content recognition service providing server 20 provides a content recognition service that enables the video display device 100 to recognize content based on main audio-visual content. The content recognition service providing server 20 may or may not modify the main audio-visual content. There may be one or more content recognition service providing servers.

The content recognition service providing server 20 may be a watermark server that inserts a visible watermark, such as a logo, into the main audio-visual content by modifying the main audio-visual content. The watermark server may watermark the logo of the content provider on the upper left or the upper right of each frame of the main audio and video content.

In addition, the content recognition service providing server 20 may be a watermark server that transforms the main audio-visual content and inserts the content information into the main audio-visual content as an invisible watermark.

Also, the content recognition service providing server 20 may be a fingerprint server that extracts and stores feature information from some frames or some audio samples of main audio-visual content. This feature information is also called a signature.

The multi-channel video distribution server 30 receives and multiplexes broadcast signals from a plurality of broadcasting stations, and provides the multiplexed signals to the broadcast reception device 60. In particular, the multi-channel video distribution server 30 performs demodulation and channel decoding on the received broadcast signal to extract main audio-visual content and additional services, and then performs channel encoding on the extracted main audio-visual content and the extracted additional service. Multiplexed signals can be generated for distribution. At this time, since the multi-channel video distribution server 30 may exclude the extracted supplementary service or add another supplementary service, the broadcasting station cannot provide the broadcaster-led service. There may be one or more multichannel video distribution servers.

The broadcast reception device 60 tunes a channel selected by a user, receives a signal of the tuned channel, and performs demodulation and channel decoding on the received signal to extract main audio-visual content. In addition, the broadcast receiving device 60 converts the extracted main audio-visual content into H.264/MPEG-4 Moving Picture Experts Group-4 advanced video coding (AVC), Dolby AC-3, and MPEG-2 Moving Picture Experts Group-2 Advanced (AAC). Audio Coding) algorithm, or the like, is used to generate uncompressed main AV content. The broadcast receiving device 60 provides the generated uncompressed main audio-visual content to the video display device 100 through an external input port of the video display device 100.

The additional service information providing server 40 provides additional service information for one or more available additional services related to the main audio-visual content in response to a request from the video display device. There may be one or more additional service address providing servers. The additional service information providing server 40 may provide additional service information for an additional service having the highest priority among a plurality of available additional services.

The additional service providing server 50 provides one or more additional services that can be used in relation to the main audio-visual content in response to a request from the video display device. There may be one or more additional service providing servers.

The video display device 100 may be a display device such as a television, a laptop computer, a mobile phone, and a smart phone. The video display device 100 may receive uncompressed main audio-visual content from the broadcast receiving device 60, or broadcast including the encoded main audio-visual content from the content providing server 10 or the multi-channel video distribution server 30 It can also receive signals. The video display device 100 may receive a content recognition service from the content recognition service providing server 20 through the network 70, and the main audio-visual content and the main audio-visual content from the additional service information providing server 40 through the network 70 Addresses of one or more additional services that can be used in connection may be received, and one or more additional services that can be used in relation to the main audio-visual content may be provided from the additional service providing server 50.

Two or more of the content providing server 10, the content recognition service providing server 20, the multi-channel video distribution server 30, the additional service information providing server 40, and the plurality of additional service providing servers 50 are one server It can be combined in the form of, or it can be operated by a single operator.

2 is a block diagram showing a watermark-based network topology according to an embodiment of the present invention.

As shown in FIG. 2, the network topology according to an embodiment of the present invention further includes a watermark server 21.

The watermark server 21 as shown in FIG. 2 inserts content information into the main audio-visual content by applying a transformation to the main audio-visual content. The multi-channel video distribution server 30 receives and distributes a broadcast signal including the modified main audio-visual content. In particular, the watermark server may use a digital watermarking technology as described below.

Digital watermark is a process of inserting information into a digital signal in a way that is difficult to delete. For example, the digital signal can be audio, photo, or video. When this digital signal is copied, the inserted information is also contained in the copy. One digital signal can carry several different watermarks at the same time.

In visible watermarking, the inserted information is visually identifiable in a photo or video. Typically, the embedded information is text or a logo that identifies the owner of the media. When a television station adds its logo to the corner of the video being transmitted, this is a visually identifiable watermark.

In invisible watermarking, information is added to audio, photo, or video as digital data, but the fact that a certain amount of information is hidden is detectable, but such information cannot be recognized. Secret messages may be delivered through watermarking that cannot be identified by the eye.

One application of watermarking is in a copyright protection system to prevent illegal copying of digital media. For example, the duplicating device may obtain a watermark from the digital media before duplicating the digital media, and determine whether or not to duplicate based on the contents of the watermark.

Another application of watermarking is in tracking the origin of digital media. At each point on the distribution path, a watermark is embedded in the digital media. If such digital media is discovered later, a watermark can be extracted from the digital media, and the source of distribution can be identified from the contents of the watermark.

Description of digital media is another application of watermarking that cannot be identified by the eye.

The file format for digital media may contain additional information called metadata, which is distinguished from metadata in that digital watermarks are transmitted as audiovisual signals of digital media themselves.

Watermarking methods include spread spectrum, quantization, and amplitude modulation.

If the signal to be marked is obtained by further modification, the watermarking method corresponds to the spread spectrum. Spread spectrum watermarks are known to be quite robust, but not much information is carried because the watermark interferes with the embedded host signal.

If the signal to be marked is obtained by quantization, the watermarking method corresponds to the quantization type. Quantization watermarks have low robustness, but can carry quite a bit of information.

If the signal to be marked is obtained with an additional correction method similar to the spread spectrum in the spatial domain, the watermarking method corresponds to amplitude modulation.

3 is a ladder diagram showing a data flow in a watermark-based network topology according to an embodiment of the present invention.

First, the content providing server 10 transmits a broadcast signal including main audio-visual content and additional services (S101).

The watermark server 21 receives a broadcast signal provided by the content providing server 10 and inserts a visible watermark such as a logo into the main audio-visual content by modifying the main audio-visual content, or Watermark information is inserted as an invisible watermark, and the watermarked main audio-visual content and additional services are provided to the MVPD 30 (S103).

Watermark information inserted through an invisible watermark may include one or more of a watermark purpose, content information, additional service information, and available additional services. The watermark usage may represent one of prevention of unauthorized copying, rating survey, and additional service acquisition.

Content information includes identification information of the content provider providing the main audio-visual content, main audio-visual content identification information, main audio-visual content rating information, time information of the content section used to acquire content information, the name of the channel on which the main audio-visual content is broadcast, and the main Among the logos of channels on which audio-visual content is broadcast, description of the channel on which main audio-visual content is broadcast, usage information reporting address, usage information reporting period, minimum usage time for obtaining usage information, and additional service information available in relation to the main audio-visual content It may contain more than one.

If the video display device 100 uses a watermark to acquire content information, time information of a content section used to acquire content information may be time information of a content section into which the used watermark is embedded. If the video display device 100 uses a fingerprint to acquire content information, time information of a content section used to acquire content information may be time information of a content section from which feature information is extracted. The time information of the content section used to acquire content information is the start time of the content section used to acquire the content information, the duration of the content section used to acquire the content information, and the end time of the content section used to acquire content information. It may include one or more of.

The usage information reporting address may include one or more of a main audio-visual content viewing information reporting address and an additional service usage information reporting address. The usage information reporting period may include one or more of a main audio-visual content viewing information reporting period and an additional service usage information reporting period. The minimum usage time for acquiring use information may include at least one of a minimum viewing time for acquiring main audio-visual content viewing information and a minimum usage time for extracting additional service usage information.

Based on the case where the main audio-visual content is viewed for more than the minimum viewing time, the video display device 100 acquires viewing information of the main audio-visual content, and viewing information extracted as the main audio-visual content viewing information report address in the main audio-visual content viewing information reporting period Can report.

Based on a case in which the additional service is used for more than the minimum usage time, the video display device 100 may obtain the additional service usage information and report the usage information extracted to the supplementary service usage information reporting address in the additional service usage information reporting period. .

The additional service information includes information on whether an additional service exists, an address of a server providing an additional service address, an acquisition path of each available additional service, an address for each available additional service, a start time of each available additional service, End time of each available supplementary service, lifetime of each available supplementary service, acquisition mode of each available supplementary service, request period for each available supplementary service, and each available supplementary service It may include at least one of priority information, description of each available supplementary service, category of each available supplementary service, usage information report address, usage information report period, minimum usage time for obtaining usage information have.

An available supplementary service acquisition path may indicate IP or ATSC Advanced Television Systems Committee-Mobile/Handheld (M/H). When the available supplementary service acquisition path is ATSC M/H, the supplementary service information may further include frequency information and channel information. The acquisition mode of each available supplementary service may indicate Push or Pull.

Meanwhile, the watermark server 21 may insert watermark information as an invisible watermark in the logo of the main audio-visual content.

For example, the watermark server 21 may insert a barcode at a predetermined position of the logo. In this case, the predetermined position of the logo may correspond to the lower one line of the area where the logo is displayed. When the video display device 100 receives main audio-visual content including a logo in which a barcode is inserted as described above, the barcode may not be displayed.

In addition, the watermark server 21 may insert watermark information in the form of metadata of a logo. At this time, the shape of the logo can be maintained.

Further, the watermark server 21 may insert N-bit watermark information into each of the logos of M frames. That is, the watermark server 21 may insert M*N watermark information through M frames.

The MVPD 30 receives a broadcast signal including a watermarked main audio-visual content and an additional service, generates a multiplexed signal and provides it to the broadcast receiving device 60 (S105). In this case, the multiplexed signal may exclude the received additional service or include a new additional service.

The broadcast reception device 60 tunes a channel selected by a user, receives a signal of the tuned channel, demodulates the received broadcast signal, performs channel decoding, and performs audio-visual decoding to perform uncompressed main audio-visual After the content is generated, the generated uncompressed main audio-visual content is provided to the video display device 100 (S106).

Meanwhile, the content providing server 10 also broadcasts a broadcast signal including main audio-visual content through a wireless channel or the like (S107).

In addition, the MVPD 30 may directly transmit a broadcast signal including main audio-visual content to the video display device 100 without passing through the broadcast receiving device 60 (S108).

The video display device 100 may receive uncompressed main audio-visual content through the set-top box 60. Alternatively, the video display device 100 may receive a broadcast signal through a wireless channel, demodulate and decode the received broadcast signal to obtain main audio-visual content. Alternatively, the video display device 100 may receive a broadcast signal from the MVPD 30, demodulate and decode the received broadcast signal to receive main audio-visual content. The video display device 100 extracts watermark information from some frames or audio samples of some sections of the acquired main audio-visual content. When the watermark information corresponds to the logo, the video display device 100 checks the watermark server address corresponding to the logo extracted from the correspondence between the plurality of logos and the plurality of watermark server addresses. When the watermark information corresponds to the logo, the video display device 100 cannot identify the main audio-visual content only with the logo. Also, even when the watermark information does not include content information, the video display device 100 cannot identify the main audio-visual content, but the watermark information may include content provider identification information or a watermark server address. When the watermark information includes content provider identification information, the video display device 100 includes a watermark server address corresponding to the content provider identification information extracted from the correspondence between the plurality of content provider identification information and the plurality of watermark server addresses. You can check. As described above, when the main audio-visual content cannot be identified only with the watermark information, the video display device 100 accesses the watermark server 21 corresponding to the acquired watermark server address and transmits the first query ( S109).

The watermark server 21 provides a first response to the first query (S111). This first response may include one or more of content information, additional service information, and available additional services.

If the watermark information and the first response do not include the additional service address, the video display device 100 cannot acquire the additional service. However, the watermark information and the first response may include the additional service address providing server address. As described above, if the video display device 100 did not acquire an additional service address or an additional service through the watermark information and the first response and acquires the additional service address providing server address, the video display device 100 The second query including content information is transmitted by accessing the additional service information providing server 40 corresponding to the service address providing server address (S119).

The supplementary service information providing server 40 searches for one or more available supplementary services related to the content information of the second query. Thereafter, the additional service information providing server 40 provides additional service information for one or more available additional services to the video display device 100 in a second response to the second query (S121).

If the video display device 100 has obtained one or more available supplementary service addresses through watermark information, a first response, or a second response, the video display device 100 accesses the one or more available supplementary service addresses to request supplementary services (S123). , Acquires an additional service (S125).

4 shows a watermark-based content recognition timing according to an embodiment of the present invention.

As shown in FIG. 4, the broadcast reception device 60 is turned on and tunes the channel, and the video display device 100 is the main audio-visual of the channel tuned from the broadcast reception device 60 through the external input port 111. Upon receiving the content, the video display device 100 may detect a content provider identifier (or a broadcasting station identifier) from the watermark of the main audio-visual content. Thereafter, the video display device 100 may detect content information from a watermark of the main audio-visual content based on the detected content provider identifier.

In this case, as shown in FIG. 4, a detectable period of a content provider identifier and a detectable period of content information may be different. In particular, the detection possible period of the content provider identifier may be shorter than the detection possible period of the content information. Through this, the image display device 100 may have an efficient configuration for detecting only necessary information.

5 is a block diagram showing a fingerprint-based network topology according to an embodiment of the present invention.

As shown in FIG. 5, the network topology according to an embodiment of the present invention further includes a fingerprint server 22.

The fingerprint server 22 as shown in FIG. 5 does not modify the main audio-visual content, but extracts and stores feature information from some frames or audio samples of some sections of the main audio-visual content. Thereafter, upon receiving the feature information from the video display device 100, the fingerprint server 22 provides an identifier and time information of the audio-visual content corresponding to the received feature information.

6 is a ladder diagram illustrating a data flow in a fingerprint-based network topology according to an embodiment of the present invention.

First, the content providing server 10 transmits a broadcast signal including main audio-visual content and additional services (S201).

The fingerprint server 22 receives a broadcast signal provided by the content providing server 10, extracts a plurality of feature information from a plurality of frame sections or a plurality of audio sections of the main audio and video content, and extracts a plurality of feature information from each A database for a plurality of corresponding query results is constructed (S203). The query result may include one or more of content information, additional service information, and available additional services.

The MVPD 30 receives a broadcast signal including main audio-visual content and an additional service, generates a multiplexed signal, and provides it to the broadcast receiving device 60 (S205). In this case, the multiplexed signal may exclude the received additional service or include a new additional service.

The broadcast reception device 60 tunes a channel selected by a user, receives a signal of the tuned channel, demodulates the received broadcast signal, performs channel decoding, and performs audio-visual decoding to perform uncompressed main audio-visual After the content is generated, the generated uncompressed main audio-visual content is provided to the video display device 100 (S206).

Meanwhile, the content providing server 10 also broadcasts a broadcast signal including main audio-visual content through a wireless channel or the like (S207).

In addition, the MVPD 30 may directly transmit a signal including the main audio-visual content to the video display device 100 without passing through the broadcast receiving device 60 (S208).

The video display device 100 may receive uncompressed main audio-visual content through the set-top box 60. Alternatively, the video display device 100 may receive a broadcast signal through a wireless channel, demodulate and decode the received broadcast signal to obtain main audio-visual content. Alternatively, the video display device 100 may receive a broadcast signal from the MVPD 30, demodulate and decode the received broadcast signal to receive main audio-visual content. The video display device 100 extracts feature information from some frames of the acquired main audio-visual content or audio samples of some sections (S213).

The video display device 100 accesses the fingerprint server 22 corresponding to a preset fingerprint server address and transmits a first query including the extracted feature information (S215).

The fingerprint server 22 provides the query result as a first response to the first query (S217). If the first response corresponds to failure, the video display device 100 may access the fingerprint server 22 corresponding to another fingerprint server address and transmit a first query including the extracted feature information.

The fingerprint server 22 may provide an XML (Extensible Markup Language) document as a result of a query. An example of an XML document containing a query result will be described with reference to FIG. 7 and Table 1.

7 shows an XML schema diagram of ACR-Resulttype containing a query result according to an embodiment of the present invention.

As shown in FIG. 7, the ACR-Resulttype containing the query result has a ResultCode property, ContentID, NTPTimestamp, SignalingChannelInformation, and ServiceInformation elements.

For example, if the ResultCode property has a value of 200, this may mean that the query result is successful. If the ResultCode property has a value of 404, this may mean that the query result has failed.

SignalingChannelInformation element has a SignalingChannelURL element, and SignalingChannelURL element has UpdateMode and PollingCycle properties. The UpdateMode property can have a Pull value or a Push value.

The ServiceInformation element has ServiceName, ServiceLogo, and ServiceDescription elements.

Table 1 shows the XML Schema of ACR-ResultType containing such query results.

As the ContentID element, an ATSC content identifier as shown in Table 2 below may be used.

As shown in Table 2, the ATSC content identifier has a structure consisting of TSID and house number.

The 16-bit unsigned integer TSID carries a transport stream identifier.

The 5-bit unsigned integer end_of_day is set to the hour of the day when the content_id value can be reused after broadcasting ends.

The 9-bit unsigned integer unique_for is set to the number of days in which the content_id value cannot be reused.

content_id represents a content identifier. The video display device 100 may reduce unique_for by 1 at a time corresponding to end_of_day every day, and may regard content_id as unique if unique_for does not become 0.

Meanwhile, as the ContentID element, a global service identifier for ATSC-M/H service as described below may be used.

The global service identifier has the following form.

-urn:oma:bcast:iauth:atsc:service:<region>:<xsid>:<serviceid>

Here, <region> is an international country code of two characters as defined by ISO 639-2. <xsid> for local service is a decimal number of TSID as defined in <region>, and <xsid> for regional service (major> 69) is "0". <serviceid> is defined as <major> or <minor>. <major> represents a major channel number, and <minor> represents a minor channel number.

An example of a global service identifier is as follows.

-urn:oma:bcast:iauth:atsc:service:us:1234:5.1

-urn:oma:bcast:iauth:atsc:service:us:0:100.200

Meanwhile, as the ContentID element, an ATSC content identifier as described below may be used.

The ATSC content identifier has the following form.

urn:oma:bcast:iauth:atsc:content:<region>:<xsidz>:<contentid>:<unique_for>:<end_of_day>

Here, <region> is an international country code of two characters as defined by ISO 639-2. <xsid> for local service is a decimal number of TSID as defined in <region>, and may be followed by "." <serviceid>. <xsid> for regional service (major> 69) is <serviceid>. <content_id> is the base64 code of the content_id field defined in Table 2, <unique_for> is the decimal code of the unique_for field defined in Table 2, and <end_of_day> is the decimal code of the end_of_day field defined in Table 2. .

Hereinafter, FIG. 6 will be described again.

If the query result does not include an additional service address or an additional service, but includes an additional service address providing server address, the video display device 100 includes the additional service information providing server 40 corresponding to the acquired additional service address providing server address. Access to and transmit a second query including content information (S219).

The supplementary service information providing server 40 searches for one or more available supplementary services related to the content information of the second query. Thereafter, the additional service information providing server 40 provides additional service information for one or more available additional services to the video display device 100 in a second response to the second query (S221).

If the video display device 100 has obtained one or more available supplementary service addresses through a first response or a second response, the video display device 100 accesses the one or more available supplementary service addresses to request supplementary services (S223), and provides additional services. Acquire (S225).

When the UpdateMode property has a Pull value, the video display device 100 transmits an HTTP request to the additional service providing server 50 through the SignalingChannelURL, and sends an HTTP response including the PSIP binary stream as a response to the additional service providing server ( 50). In this case, the video display device 100 may transmit an HTTP request according to a polling cycle designated as a PollingCycle property. Also, the SignalingChannelURL element may have an update time attribute. In this case, the video display device 100 may transmit an HTTP request at an update time designated as an update time attribute.

When the UpdateMode property has a Push value, the video display device 100 may asynchronously receive an update from the server using the XMLHTTPRequest API. This is a method of providing signaling information as a response through this channel when the server changes signaling information after the video display device 100 makes an asynchronous request to the server through the XMLHTTPRequest object. When there is a limit on the waiting time of the session, a session timeout respond is generated, and the receiver immediately recognizes and re-requests it, thereby maintaining the signaling channel between the receiver and the server at all times.

8 is a block diagram illustrating a network topology based on a watermark and a fingerprint according to an embodiment of the present invention.

As shown in FIG. 8, the network topology according to an embodiment of the present invention further includes a watermark server 21 and a fingerprint server 22.

The watermark server 21 as shown in FIG. 8 inserts content provider identification information into the main audio-visual content. The watermark server 21 may insert content provider identification information into the main audio-visual content as a watermark that looks like a logo, or may insert content provider identification information into the main audio-visual content as an invisible watermark.

The fingerprint server 22 does not modify the main audio-visual content, but extracts and stores feature information from some frames of the main audio-visual content or audio samples of a partial section. Thereafter, upon receiving the feature information from the video display device 100, the fingerprint server 22 provides an identifier and time information of the audio-visual content corresponding to the received feature information.

9 is a ladder diagram showing data flow in a watermark and fingerprint based network topology according to an embodiment of the present invention.

First, the content providing server 10 transmits a broadcast signal including main audio-visual content and additional services (S301).

The watermark server 21 receives a broadcast signal provided by the content providing server 10 and inserts a visible watermark such as a logo into the main audio-visual content by modifying the main audio-visual content, or Watermark information is inserted as an invisible watermark, and the watermarked main audio-visual content and additional services are provided to the MVPD 30 (S303). Watermark information inserted through an invisible watermark may include one or more of content information, additional service information, and available additional services. Content information and additional service information are as described above.

The MVPD 30 receives a broadcast signal including a watermarked main audio-visual content and an additional service, generates a multiplexed signal and provides it to the broadcast receiving device 60 (S305). In this case, the multiplexed signal may exclude the received additional service or include a new additional service.

The broadcast reception device 60 tunes a channel selected by a user, receives a signal of the tuned channel, demodulates the received broadcast signal, performs channel decoding, and performs audio-visual decoding to perform uncompressed main audio-visual After the content is generated, the generated uncompressed main audio-visual content is provided to the video display device 100 (S306).

Meanwhile, the content providing server 10 also broadcasts a broadcast signal including the main audio-visual content through a wireless channel or the like (S307).

In addition, the MVPD 30 may directly transmit a signal including the main audio-visual content to the video display device 100 without passing through the broadcast receiving device 60 (S308).

The video display device 100 may receive uncompressed main audio-visual content through the set-top box 60. Alternatively, the video display device 100 may receive a broadcast signal through a wireless channel, demodulate and decode the received broadcast signal to obtain main audio-visual content. Alternatively, the video display device 100 may receive a broadcast signal from the MVPD 30, demodulate and decode the received broadcast signal to receive main audio-visual content. The video display device 100 extracts watermark information from some frames of the acquired main audio-visual content or audio samples of some sections. When the watermark information corresponds to the logo, the video display device 100 checks the watermark server address corresponding to the logo extracted from the correspondence between the plurality of logos and the plurality of watermark server addresses. When the watermark information corresponds to a logo, the video display device 100 cannot identify the main audio-visual content with only the logo. Also, even when the watermark information does not include content information, the video display device 100 cannot identify the main audio-visual content, but the watermark information may include content provider identification information or a watermark server address. When the watermark information includes content provider identification information, the video display device 100 includes a watermark server address corresponding to the content provider identification information extracted from the correspondence between the plurality of content provider identification information and the plurality of watermark server addresses. You can check. As described above, when the main audio-visual content cannot be identified only with the watermark information, the video display device 100 accesses the watermark server 21 corresponding to the acquired watermark server address and transmits the first query ( S309).

The watermark server 21 provides a first response to the first query (S311). This first response may include one or more of a fingerprint server address, content information, additional service information, and available additional services. Content information and additional service information are as described above.

If the watermark information and the first response include the fingerprint server address, the video display device 100 extracts feature information from some frames of the main audio-visual content or audio samples of some sections (S313).

The video display device 100 accesses the fingerprint server 22 corresponding to the fingerprint server address in the first response and transmits a second query including the extracted feature information (S315).

The fingerprint server 22 provides the query result as a second response to the second query (S317).

If the query result does not include an additional service address or an additional service, but includes an additional service address providing server address, the video display device 100 includes the additional service information providing server 40 corresponding to the acquired additional service address providing server address. Access to and transmit a third query including content information (S319).

The supplementary service information providing server 40 searches for one or more available supplementary services related to the content information of the third query. Thereafter, the additional service information providing server 40 provides additional service information for one or more available additional services to the video display device 100 in a third response to the third query (S321).

If the video display device 100 has obtained one or more available supplementary service addresses through a first response, a second response, or a third response, the video display device 100 accesses the one or more available supplementary service addresses to request supplementary services (S323 ), acquires an additional service (S325).

Next, a video display device 100 according to an embodiment of the present invention will be described with reference to FIG. 10.

10 is a block diagram of an image display device according to an embodiment of the present invention.

As shown in FIG. 10, the video display device 100 according to the embodiment of the present invention includes a broadcast signal receiving unit 101, a demodulation unit 103, a channel decoding unit 105, a demultiplexing unit 107, and an audio-visual It includes a decoding unit 109, an external input port 111, a playback control unit 113, a playback device 120, an additional service management unit 130, a data transmission/reception unit 141, and a memory 150.

The broadcast signal receiver 101 receives a broadcast signal from the content providing server 10 or the MVPD 30.

The demodulator 103 generates a demodulated signal by demodulating the received broadcast signal.

The channel decoding unit 105 channel-decodes the demodulated signal to generate channel-decoded data.

The demultiplexer 107 separates the main audio-visual content and the additional service from the channel-decoded data. The separated supplementary service is stored in the supplementary service storage unit 152.

The audio-visual decoding unit 109 generates uncompressed main audio-visual content by performing AV decoding on the separated main audio-visual content.

Meanwhile, the external input port 111 receives uncompressed main audio-visual content from a broadcast receiving device 60, a digital versatile disk (DVD) player, a Blu-ray disc player, or the like. The external input port 111 may include one or more of a DSUB port, a High Definition Multimedia Interface (HDMI) port, a Digital Visual Interface (DVI) port, a composite port, a component port, and an S-Video port. have.

The playback control unit 113 plays at least one of the uncompressed main audio-visual content generated by the audio-visual decoding unit 109 or the uncompressed main audio-visual content received from the external input port 111 on the playback device 120 by user selection. do.

The playback device 120 includes a display unit 121 and a speaker 123. The display unit 121 includes a liquid crystal display (LCD), a thin film transistor-liquid crystal display (TFT LCD), an organic light-emitting diode (OLED), and a flexible display. display) and a 3D display.

The supplementary service management unit 130 obtains content information of the main audio-visual content, and obtains an available supplementary service based on the obtained content information. In particular, as described above, the supplementary service management unit 130 may obtain identification information of the main audio-visual content based on some frames of the uncompressed main audio-visual content or audio samples of a partial section. In this specification, automatic content recognition ( It is also called automatic contents recognition (ACR).

The data transmission/reception unit 141 may include an ATSC-M/H (Advanced Television Systems Committee-Mobile/Handheld) channel transmission/reception unit 141a and an IP transmission/reception unit 141b.

The memory 150 is a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (for example, SD or XD memory), and RAM. (Random Access Memory, RAM), SRAM (Static Random Access Memory), ROM (Read-Only Memory, ROM), EEPROM (Electrically Erasable Programmable Read-Only Memory), PROM (Programmable Read-Only Memory), magnetic memory, magnetic It may include at least one type of storage medium among a disk and an optical disk. The video display device 100 may operate in connection with a web storage that performs a storage function of the memory 150 over the Internet.

The memory 150 includes a content information storage unit 151, an additional service storage unit 152, a logo storage unit 153, a setting information storage unit 154, a bookmark storage unit 155, and a user information storage unit 214. (156), it may include a usage information storage unit 157.

The content information storage unit 151 stores a plurality of content information corresponding to a plurality of feature information.

The additional service storage unit 152 may store a plurality of additional services corresponding to a plurality of feature information, or may store a plurality of additional services corresponding to a plurality of content information.

The logo storage unit 153 stores a plurality of logos. In addition, the logo storage unit may further store content provider identifiers corresponding to the plurality of logos or watermark server addresses corresponding to the plurality of logos.

The setting information storage unit 154 stores setting information for ACR.

The bookmark storage unit 155 stores a bookmark.

The user information storage units 214 and 156 store user information. The user information may include one or more of account information for one or more services, area information, family member information, preferred genre information, video display device information, and use information provision range. The one or more account information may include account information for the usage information measurement server, and account information of a social network service such as Twitter and Facebook. The area information may include address information and zip code. The family member information may include the number of family members, the age of each member, the sex of each member, the religion of each member, and the occupation of each member. The preferred genre information may be set to one or more of sports, movies, dramas, education, news, entertainment, and other genres. The video display device information may include information on the type of the video display device, manufacturer, firmware version, resolution, model name, OS, browser, presence or absence of a storage device, capacity of the storage device, and network speed. When the usage information provision range is set, the video display device 100 may collect and report main audio-visual content viewing information and additional service usage information within the set range. The range of providing the use information may be set for each virtual channel. In addition, the allowable range for measurement of use information may be set for the entire physical channel.

The usage information storage unit 157 stores main audio-visual content viewing information and additional service usage information collected by the video display device 100. In addition, the video display device 100 may analyze a service use pattern based on the collected main audio-visual content viewing information and the collected additional service use information, and store the analyzed service use pattern in the use information storage unit 157. .

The additional service management unit 130 may obtain content information of the main audio-visual content from the fingerprint server 22 or the content information storage unit 151. When there is no content information corresponding to the extracted feature information in the content information storage unit 151 or there is no sufficient content information, the additional service management unit 130 may receive additional content information through the data transmission/reception unit 141. In addition, the additional service management unit 130 may continuously update content information.

The additional service management unit 130 may obtain an available additional service from the additional service providing server 50 or the additional service storage unit 153. If there is no additional service or sufficient additional service in the additional service storage unit 153, the additional service management unit 130 may update the additional service through the data transmission/reception unit 141. In addition, the supplementary service management unit 130 may continuously update the supplementary service.

The supplementary service management unit 130 may extract a logo from the main audio-visual content and query the logo storage unit 155 to obtain a content provider identifier or a watermark server address corresponding to the extracted logo. When there is no logo matching the extracted logo in the logo storage unit 155 or there is no sufficient logo, the additional service management unit 130 may receive the additional logo through the data transmission/reception unit 141. In addition, the additional service management unit 130 may continuously update the logo.

The supplementary service management unit 130 compares the logo extracted from the main audio-visual content with a plurality of logos in the logo storage unit 155, and may perform various methods to reduce the burden of operation.

For example, the supplementary service management unit 130 may perform comparison based on color characteristics. That is, the supplementary service management unit 130 may compare the color characteristics of the extracted logo with the color characteristics of the logo in the logo storage unit 155 to determine whether they match.

In addition, the additional service management unit 130 may perform comparison based on character recognition. That is, the supplementary service management unit 130 may compare a character recognized from the extracted logo with a character recognized from the logo in the logo storage unit 155 to determine whether they match.

In addition, the supplementary service management unit 130 may perform comparison based on the shape of the outline of the logo. That is, the supplementary service management unit 130 may compare the outline shape of the extracted logo with the outline shape of the logo in the logo storage unit 155 to determine whether they match.

Next, FIG. 11 will be described.

11 is a diagram illustrating a system according to an embodiment of the present invention.

According to an embodiment of the present invention, user information includes, for example, user profile, demographics, and interests information. Each configuration of the system will be described below.

User profiles, demographics and interests are expressed through responses to the questionnaire. The data structure that summarizes the questionnaire and responses provided by a specific user is called a PDI questionnaire (Profile, Demographics and Interests, PDI Questionnaire) or a PDI table. In the PDI table, the part corresponding to the question is called PDI Question or PDI-Q, and the part corresponding to the response is called PDI Answer or PDI-A. The set of filter criteria is referred to as PDI-Filtering Criteria (PDI-FC).

Receivers available in ATSC 2.0/ATSC 3.0 include the ability to generate a response (PDI-A instance) corresponding to a questionnaire in questionnaire. The PDI-A creation function is used as an input to the PDI-Q instance. The receiver also provides a filter function for determining content suitable for download and use by comparing PDI-A to the PDI-FC.

As shown in FIG. 11, the system includes a content providing server 10, an image display device 100, a wearable device 200, one or more interworking devices 300, and a health care server 500.

The content providing server 10 may correspond to a broadcasting station or the like and broadcasts a broadcast signal including main audio-visual content. The content providing server 10 may transmit content, a personalization service, a PDI questionnaire, and a filtering criterion to the video display device 100. A data structure in which a questionnaire and a response from a specific user are summarized may be referred to as a PDI Questionnaire. According to an embodiment of the present invention, a PDI questionnaire may include information on a user's profile, statistical data, and interest. The content providing server 10 includes the functions described in FIGS. 1 to 9.

The video display device 100 may process content or service received from the content providing server 10, a PDI questionnaire, and filter criteria. The video display device 100 may include all components described in FIG. 10.

The video display device 100 includes a control unit 160, a filtering engine 170, a PDI data storage unit 156, a content/service storage unit 151, a usage information storage unit 157, an interworking module 180, and a display. It may include a part 121.

The controller 160 may receive a PDI questionnaire from the content providing server 10 and transmit a PDI questionnaire reflecting a user response to the content providing server 10. The PDI questionnaire may include one or more question items that require user input. The controller 160 may obtain a PDI questionnaire reflecting a user's response from either the video display device 100 or the companion device 300. The controller 160 may check whether there is a PDI questionnaire previously stored in the PDI data storage unit 156, and may newly store or update the PDI questionnaire according to the verification result. That is, when there is a PDI questionnaire previously stored for a specific user by searching the PDI data storage unit 230, the control unit 160 can update the obtained PDI questionnaire, and when there is no PDI questionnaire previously stored for a specific user. , It is possible to store the obtained PDI questionnaire. The control unit 160 may be referred to as a control unit.

The filtering engine 170 according to an embodiment of the present invention may filter content based on a PDI questionnaire and filtering criteria. The filtering criterion refers to one set of filtering criteria for filtering only content suitable for a user based on the PDI questionnaire. The filtering engine 170 may receive a PDI questionnaire from the control unit 160 and receive content and filter criteria from the content providing server 10.

In addition, when transmitting a parameter related to declarative content (hereinafter, referred to as content), the content providing server 10 may transmit filtering criteria related to the content together. In addition, the filtering engine 170 compares the filtering criteria with the PDI questionnaire, and filters and downloads the content based on the comparison result. The downloaded content may be stored in the content/service storage unit 151.

The display unit 121 displays a PDI questionnaire received from the controller 160 and a PDI response received in response to a PDI question from a user. The user may transmit a response to the PDI questionnaire displayed on the video display device 100 through a remote control device such as a remote control.

The content may be content related to an application executed by the video display device 100 and may include a declarative object, for example, a triggered declarative object (TDO). In addition, the content may include any one of a video, an image, an audio, and an application.

The PDI data storage unit 156 stores PDI data including a PDI questionnaire and a PDI questionnaire reflecting a user response.

The content/service storage unit 151 stores the filtered content according to filter criteria created based on the PDI questionnaire.

The usage information storage unit 157 stores main audio-visual content viewing information and additional service usage information collected by the video display device 100. In addition, the video display device 100 may analyze a service use pattern based on the collected main audio-visual content viewing information and the collected additional service use information, and store the analyzed service use pattern in the use information storage unit 157. . The usage information storage unit 157 may store content usage information. Content usage information includes the number of times the user views specific content during a preset time, the number of times the user views a specific channel during a preset time, the genre of the program viewed by the user during a preset time, and It may include at least one or more of a watched program and a history of purchasing content by the user.

The interworking module 180 may transmit and receive information with the companion device 300 through a network. The interworking module 180 may include a short-range wireless communication module such as Bluetooth, Wi-Fi, and Zigbee.

The wearable device 200 may transmit and receive information with the video display device 100 through wired communication or wireless communication.

The companion device 300 may be paired with the video display device 100 to transmit and receive information with the video display device 100. The companion device 300 may be a mobile terminal such as a smartphone, a smart pad, and a notebook. The companion device 300 may be a wearable device 200.

The healthcare server 500 may receive the user's biometric information and the user's exercise information from the image display device 100 or the wearable device 200. The healthcare server 500 may provide a health management service to the image display device 100 or the wearable device 200 based on the received user's biometric information and the user's exercise information.

Next, FIG. 12 will be described.

12 is a block diagram of a wearable device according to an embodiment of the present invention.

Referring to FIG. 12, the wearable device 200 includes a communication unit 210, a display unit 230, a sensing unit 250, a memory unit 270, and a control unit 290.

The communication unit 210 may exchange information with the interworking module 180 of the video display device 100 through wired communication or wireless communication. In particular, the communication unit 210 may acquire body information and exercise information of the user and transmit it to the interworking module 180 of the image display device 100.

The user's body information may include information on a user's body part, such as a user's heart rate, a user's body temperature, and a blood pressure.

The user's exercise information may include the user's pulse rate, exercise distance, exercise time, number of steps, target amount, and achievement amount.

The display unit 230 may display an image signal, an audio signal, and the like processed by the control unit 290.

The detection unit 250 may detect a user's physical condition. The sensing unit 250 may detect the user's heart rate, the user's body temperature, and blood pressure. To this end, the sensing unit 250 may include a heart rate sensor, a temperature sensor, a blood pressure measurement sensor, and the like.

The detection unit 250 may detect a user's exercise state. The sensing unit 250 may include an acceleration sensor, a vibration sensor, or the like to check the motion state of the user.

The memory unit 270 may store a signal processed by the controller 290 and a program for controlling signal processing. In addition, the memory unit 270 may store a signal-processed video, audio, or data signal.

The controller 290 may control the overall operation of the wearable device 200. The controller 290 may transmit the user's exercise information to the video display device 100 through the communication unit 210.

The controller 290 may receive a control command from the video display device 200 and control a function of the wearable device 200 corresponding to the control command.

Next, FIG. 13 will be described.

13 is a ladder diagram illustrating a method of operating a system according to an embodiment of the present invention.

The user management engine 190 of the video display device 100 receives user identification information for identifying a user, and identifies a user based on the received user identification information (S501).

In an embodiment, the user management engine 190 may receive an ID and a password for logging in to the image display device 100 from a specific user, and may identify a user based on the received ID and password.

In another embodiment, the user management engine 190 may receive body information on a part of the user's body, and may identify a user based on the received body information. A part of the body may be either a user's face or a user's fingerprint. When the user is identified through the user's face, the user management engine 190 may include a camera. When the user is identified through the user's fingerprint, the remote control for controlling the operation of the image display device 100 may receive the user's fingerprint. The remote control may include a fingerprint recognition sensor, and may transmit an input user's fingerprint to the image display device 100. The user management engine 190 may identify a user through a matching process between the received user's fingerprint and a previously registered fingerprint.

In another embodiment, the user management engine 190 may receive a user's voice command and identify a user based on the received voice command. The user management engine 190 may store voice commands for identifying each user in correspondence with each user. The user management engine 10 may identify a user through a matching process between the received user's utterance and a previously stored utterance.

In another embodiment, the user management engine 190 may identify a user or a user group according to a request to select an icon. That is, the display unit 121 of the image display device 100 may display a plurality of identification icons when the image display device 100 is powered on. The plurality of identification icons may include a group icon and one or more personal icons. The user management engine 190 may receive a request for selecting any one of a plurality of identification icons, and may provide a home screen corresponding to the selected icon according to the received request. This will be described with reference to FIG. 14.

14 is an embodiment in which a user is identified through a plurality of icons and a home screen corresponding to the identified user is provided according to an embodiment of the present invention.

Referring to FIG. 14, an initial screen in a state before entering the home screen after the video display device 100 is powered on is shown. A plurality of icons are displayed on the initial screen of the video display device 100. That is, the video display device 100 includes a group icon (A), a first user icon (B), a second user icon (C), a third user icon (D), and a fourth user icon (E) on the initial screen. Can be displayed. The video display device 100 may receive a request to select any one of a plurality of displayed icons, and display a home screen corresponding to the selected icon according to the received request. For example, when each user icon represents a member, a specific family member may want a home screen that suits them. After selecting an icon corresponding to the family member, a specific home screen may be provided through a login button. When the group icon A is selected, the video display device 100 may display a general home screen. Of course, family members can be provided with a home screen corresponding to themselves only by selecting an icon without selecting a login button.

Each home screen may display family members' favorite content, favorite items, recent viewing or execution list, and the like. Family members can be provided with a home screen that suits them just by selecting an icon corresponding to them.

Fig. 13 will be described again.

The control unit 160 of the video display device 100 acquires content use information of the identified user (S503).

In one embodiment, the content usage information includes the number of views for a specific channel during a preset time, the number of views of a program of a specific genre at a preset time, a program viewed by a user during a preset time, a history of content purchase by the user, and a specific application. It may include at least one or more of the number of executions.

In an embodiment, the controller 160 may acquire content use information based on the user's content viewing history. That is, the video display device 100 may collect information about content recently viewed by the user, and acquire content use information based on information about the collected content.

In another embodiment, the controller 160 may acquire content use information based on cookie information. Cookie information may represent a small log information file that is installed on the Internet user's computer by the server used by the website.

In another embodiment, the controller 160 may acquire content use information based on automatic content recognition (ACR). In this case, the control unit 160 may include the additional service management unit 130 shown in FIG. 10. Specifically, automatic content recognition may include a watermark method or a fingerprint method described in FIGS. 1 to 10. The watermark method is a technology for recognizing content based on a visible watermark such as a logo or an invisible watermark on the main audiovisual content by applying a transformation to the main audiovisual content. The fingerprint method is a technology for recognizing content based on feature information extracted from some frames or some audio samples of main audio-visual content. The controller 160 may acquire user content usage information based on the automatic content recognition technology as described above.

The control unit 160 of the video display device 100 compares the number of use of the content and a threshold value based on the received content use information (S505), and checks whether the number of use of the content is greater than or equal to the threshold value as a result of the comparison (S507). .

The number of times the content is used may be one of the number of times the content is viewed and the number of times the content is downloaded or uploaded. In some cases, the number of times the content is used may be a concept including the number of times the content provider is accessed.

In an embodiment, the threshold may be a minimum number of times of content use as a reference for transmitting a PDI questionnaire to the video display device 100. When the user views a specific genre and a program corresponding to the genre type for a preset time period more than a preset number of times, the content providing server 10 may determine that the number of times the content is used satisfies the threshold. For example, if a user has watched a professional baseball broadcast four or more times in a week, the content providing server 10 can determine that the user is interested in baseball among the types of genre called sports, and satisfies the threshold. I can judge. Here, a week and 4 times are only examples.

In an embodiment of the present invention, it is described that the video display device 100 performs a process of comparing the number of times of use of content and a threshold value, but there is no need to be limited thereto. That is, the video display device 100 may transmit the use information of the content to the content providing server 10, and the content providing server 10 compares the number of times of use of the content and a threshold value based on the use information of the received content. You can do the job. The content providing server 10 may generate a PDI questionnaire according to a result of comparing the number of times of use of the content and the critical dentistry, and transmit the generated PDI questionnaire to the image display apparatus 100 or the companion device 300.

When the number of times of use of the content satisfies the threshold, the controller 160 of the video display device 100 requests the content providing server 10 for a PDI questionnaire that is a basis for providing a personalized service (S509).

The content providing server 10 transmits a PDI questionnaire for a personalized service to the control unit 160 of the video display device 100 (S511).

In an embodiment, the content providing server 10 may transmit a PDI questionnaire to the video display device 100 to provide a personalized service for a specific user.

In another embodiment, the content providing server 10 may transmit a PDI questionnaire to the companion device 300 paired with the video display device 100.

The XML schema structure of the PDI questionnaire will be described with reference to FIG. 15.

15 is a diagram illustrating an XML schema table of a PDI questionnaire according to an embodiment of the present invention.

PDI questionnaire refers to a document that can be obtained by executing PDI table of XML schema. The question part in the PDI table may be informally referred to as "PDI question" or "PDI-Q". The answer to a given PDI question can be informally referred to as "PDI-A".

PDI-Q and PDI-A can be obtained by executing a PDI table including PDI-Q and PDI-A of an XML schema. PDI-Q and PDI-A are available in types QIA (Integer Answered Questions), QBA (Boolean Answered Questions), QSA (Selective Questions), QTA (Text Answered Questions) and QAA (Random Answered Questions). Can include.

As illustrated in FIG. 15, in order to distinguish between characteristics and elements, "@" may be displayed in front of the element name in the PDI table according to the present embodiment.

As shown in FIG. 15, the PDI user data table (hereinafter, the PDI table) is independent of the question type element, a protocol version element, a user data identifier (userDataId) element, a user data version element, and time. An element and a user identifier (user_id) element may be included. In addition, the PDI table may include one or more question elements. Each of the question elements may be any one of QIA, QBA, QSA, QTA, and QAA. 1..N in <choice> means that each question element can appear in any order.

The protocolVersion element of the PDI table may be composed of hexadecimal numbers. The upper 4 bits indicate the major version of the protocol, and the lower 4 bits indicate the minor version of the protocol. When the major version of the corresponding PDI table is set to 1, a receiver such as the video display device 100 may determine that the PDI specified by the major version not supported by the corresponding receiver will be discarded. When the minor version of the corresponding PDI table is set to 0, the receiver may determine that the PDI specified by the minor version not supported by the corresponding receiver will not be discarded. In this case, the receiver may determine that each element not supported by the corresponding receiver can be ignored.

The userDataId of the PDI table may be a globally unique identifier of the PDI user data.

The userDataVersion of the PDI table may be a version of the PDI user data. This value can range from 0 to 255. As userDataVersion increases by 1, it can mean different users.

The time element of the PDI table indicates the latest change time of the question in the PDI table.

The user_id element of the PDI table may be an identifier identifying a user of the corresponding table. The video display device 100 may identify PDI questionnaires obtained from multiple users through user_id.

The QIA element represents an integer response to a question. The QIA element may contain content that selectively limits the minimum and maximum allowed values of the response.

The QBA element represents a Boolean response to a question.

The QSA element represents an optional response to a question. The QSA element may include a QSA.minchoice element, and the QSA.minchoice element may designate a minimum number that a user can select. In addition, the QSA element may include a QSA.maxchoice element, and the QSA.maxchoice element may designate the maximum number that a user can select.

The QTA element represents a text response to a question.

The QAA element represents an arbitrary (freeform) response to a question.

Fig. 13 will be described again.

The display unit 121 of the video display device 100 displays the PDI questionnaire received from the content providing server 10 (S512).

In an embodiment, the control unit 160 may control the display unit 121 to display a PDI questionnaire received from the content providing server 10 while the user is watching content.

In another embodiment, the PDI questionnaire received from the content providing server 10 may be set to be displayed or not displayed. For example, when the user has set not to display the PDI questionnaire, the video display device 100 may not display the PDI questionnaire even if it receives the PDI questionnaire from the content providing server 10. If the user sets the PDI questionnaire to be displayed, the video display device 100 may immediately display the received PDI questionnaire when receiving the PDI questionnaire from the content providing server 10.

In another embodiment, when receiving a PDI questionnaire from the content providing server 10, the control unit 160 does not display the PDI questionnaire, and displays an indicator indicating that the PDI questionnaire has been received on one side of the screen. Can be controlled. When a request for selecting an indicator is received, the controller 160 may control the display unit 121 to display the PDI questionnaire received from the content providing server 10.

The controller 160 of the video display device 100 receives a setting input for setting a collection target and a collection time on the PDI questionnaire (S513).

Steps S512 and S513 will be described with reference to FIGS. 16 to 18.

16 to 17 are diagrams for explaining an example in which a video display device displays a PDI questionnaire received from a content providing server according to an embodiment of the present invention.

In particular, FIG. 16 is a diagram illustrating the video display device 100 displaying a PDI questionnaire, and FIG. 17 is a diagram illustrating an indicator indicating that the PDI questionnaire has been received.

Referring to FIG. 16, the controller 160 of the video display device 100 may display a PDI questionnaire 701 received from the content providing server 10 on one side of the display unit 121. That is, the control unit 160 of the video display device 100 receives the PDI questionnaire 701 from the content providing server 10 while playing specific content 703 (for example, a real-time broadcasting program) on the screen. In this case, the PDI questionnaire 701 may be displayed on one side of the screen in the form of a pop-up window. The specific content displayed on the screen may be a health-related broadcast program, and when the number of views of a health-related broadcast program is greater than or equal to a threshold for a preset period, the video display device 100 displays the PDI questionnaire 701 on the display unit ( 121).

The PDI questionnaire 701 may be displayed on the entire screen of the display unit 121 through a user input through a remote control.

The controller 160 may arrange the PDI questionnaire 701 in a specific area so as not to interfere with viewing of the content being played on the screen. Specifically, the controller 160 may recognize the content being played on the screen and place the PDI questionnaire 701 in a specific area of the screen so that the main person or object appearing in the content is not covered.

The PDI questionnaire 701 may include one or more question items. The question items shown in FIG. 16 may include a collection target item for collecting the user's biometric information and exercise information, and a collection period item for setting a collection period. The items to be collected may include options such as heart rate, blood pressure, body temperature, number of walking and number of strength exercises. The collection target period may include options such as 12 hours, 1 day, 3 days, 7 days and 30 days. The user can select options for each question item using the remote control.

The user may respond to each item of the PDI questionnaire 701 according to a key input provided in a remote control device such as a remote controller, or may terminate the PDI questionnaire 701 without a response to the PDI questionnaire 701. .

Next, FIG. 17 will be described.

Referring to FIG. 17, the controller 160 of the video display device 100 may display an indicator 705 notifying that the PDI questionnaire 701 has been received from the content providing server 10 on one side of the display unit 121. have. That is, the control unit 160 of the video display device 100 receives the PDI questionnaire 701 from the content providing server 10 while playing specific content 703 (for example, a real-time broadcasting program) on the screen. In this case, an indicator 705 indicating that the PDI questionnaire 701 has been received may be displayed on one side of the screen. When a request for selecting the indicator 705 is received from the remote control, the controller 160 may display the PDI questionnaire 701 on one side of the screen.

Next, FIG. 18 will be described.

18 is a diagram illustrating a process of receiving a user's response to a PDI questionnaire displayed on an image display device according to an embodiment of the present invention.

Referring to FIG. 18, it can be confirmed that the heart rate and the number of walking are selected from the item to be collected through input through the remote control. In the collection period item, it can be seen that 3 days is selected.

Fig. 13 will be described again.

The controller 160 of the video display device 100 transmits a setting result according to the received setting input to the wearable device 200 (S515).

In another embodiment, the controller 160 of the video display device 100 may transmit a PDI questionnaire reflecting the setting result to the content providing server 10. The content providing server 10 may transmit related content to the video display device 100 based on the PDI questionnaire in which the setting result is reflected.

The wearable device 200 collects biometric information and exercise amount information based on a setting result received from the video display device 100 (S517).

The biometric information may be information related to the user's body, such as heart rate, blood pressure, and body temperature. The exercise amount information may include the user's exercise distance, exercise time, number of walking, target exercise amount, exercise achieved, calorie consumption, etc., but is not limited thereto, and various types of wearable device 200 May contain information.

In FIG. 18, the heart rate and the number of walking were selected as the collection target through the PDI questionnaire, and 3 days were set as the collection period, so the wearable device 200 may collect the user's heart rate and the number of walking for 3 days. The heart rate sensor provided in the wearable device 200 may collect the user's heart rate in real time. The controller 290 of the wearable device 200 may obtain an average value for the heart rate for 3 days based on the heart rate collected from the heart rate sensor. The acceleration sensor provided in the wearable device 200 may collect the number of walking of the user in real time. The controller 290 may acquire the number of times the user walks every day based on the number of times the user walks collected from the acceleration sensor.

The controller 290 of the wearable device 200 determines whether at least one of the collected biometric information, the amount of exercise information, and the collection period satisfies the threshold condition (S519), and when the threshold condition is satisfied, the collected information is displayed on the image display device ( 100) (S521).

In an embodiment, when the heart rate included in the biometric information is out of a preset heart rate range, the controller 290 of the wearable device 200 may determine that the threshold condition is satisfied. For example, when the preset heart rate range is 70 to 130 and the measured user's heart rate is 150, the wearable device 200 may transmit heart rate information to the image display device 100.

In another embodiment, when the number of walking included in the exercise amount information is equal to or greater than a preset number during a preset period, the controller 290 of the wearable device 200 may determine that the threshold condition is satisfied. The preset number of times may be a target walking number set by the user. For example, if the preset number of times is 10000, the controller 290 of the wearable device 200 may transmit the number of walking to the image display device 100 even if the set collection period does not exceed 3 days.

In another embodiment, when the collection period set by the user ends, the control unit 290 of the wearable device 200 may determine that the threshold condition is satisfied. For example, when the set collection period is 3 days, the wearable device 200 may transmit the biometric information and exercise amount information collected for 3 days to the image display device 100.

Before the wearable device 200 transmits the collection information to the video display device 100, the wearable device 200 and the video display device 100 may not be paired with each other. When the threshold condition is satisfied, the wearable device 200 may attempt to pair with the video display device 100, and after being paired, may transmit the collection information to the video display device 100.

The wearable device 200 may directly transmit the collected information to the healthcare server 500. The health care server 500 may transmit a health management service generated based on the collected information to the image display device 100 or the wearable device 200.

The control unit 160 of the video display device 100 controls the display unit 121 to display the collected information received from the wearable device 200 (S523).

This will be described with reference to FIG. 19.

19 is an embodiment in which the video display device displays collection information received from the wearable device 200 according to an embodiment of the present invention.

The video display device 100 may display an exercise amount information display area 601 including exercise amount information and a biometric information display area 603 including biometric information on a screen.

The exercise amount information display area 601 may include a graph indicating the number of times the user walks during 3 days, which is a set collection period. The biometric information display area 603 may include a graph representing the user's heart rate during the set collection period of 3 days.

The user can easily check his or her health status and exercise status through the collected information displayed on the video display device 100.

The controller 160 of the video display device 100 transmits the collected information to the healthcare server 500 in order to receive a health management service (S525), and the healthcare server 500 receives from the video display device 100 The health care service is transmitted to the video display device 100 according to the collected information (S527).

The health care service may be a customized service created based on the collected information. The health care service provided by the video display device 100 will be described with reference to FIGS. 20 to 21.

20 to 21 are diagrams illustrating an embodiment in which a video display device receives a health care service according to an embodiment of the present invention.

First, referring to FIG. 20, the health management service may be a personalized exercise prescription. That is, the health care server 500 may generate a personalized exercise prescription as shown in FIG. 20 based on at least one of the user's biometric information and exercise amount information, and the personalized exercise prescription image display device 100 Can be transferred to.

Next, Fig. 21 will be described.

Referring to FIG. 21, the health management service may include a healthy diet recommendation service. That is, the health care server 500 may transmit a diet suitable for the user to the image display device 100 as shown in FIG. 21 based on at least one of the user's biometric information and exercise amount information.

The user can check a personalized exercise prescription or a healthy diet through the image display device 100, and manage health accordingly.

In another embodiment, the health management service may be a remote medical service that remotely diagnoses the user's health. That is, the health care server 500 may access the image display device 100 through a network and may provide medical services remotely with the image display device 100. The administrator of the healthcare server 500 may analyze at least one of the collected user's biometric information and exercise amount information, and remotely provide health consultation to the user according to the analysis result.

According to an embodiment of the present invention, the above-described method can be implemented as a code that can be read by a processor in a medium on which a program is recorded. Examples of media that can be read by the processor include ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage, etc., and may be implemented in the form of a carrier wave (for example, transmission over the Internet). Include.

The video display device described above is not limited to the configuration and method of the above-described embodiments, but the embodiments are configured by selectively combining all or part of each embodiment so that various modifications can be made. It could be.

Claims (12)

In the method of operating a video display device,
Recognizing content using an automatic content recognition technique;
Displaying a questionnaire for health care service when the number of times of use of the recognized content is greater than or equal to the threshold value;
Receiving a setting input for setting a collection period of the user's biometric information, exercise amount information, and the biometric information and exercise amount information on the displayed questionnaire; And
And providing the health care service based on the received setting input
How to operate the video display device. The method of claim 1,
Transmitting a setting result according to the setting input to a wearable device; And
The wearable device further comprises receiving biometric information and exercise amount information collected during the collection period,
Providing the health care service
Receiving the health management service from a health care server based on at least one of the received biometric information and exercise amount information
How to operate the video display device. The method of claim 2,
The above health care service
Including an exercise prescription and a recommended diet generated based on at least one of the biometric information and the exercise amount information
How to operate the video display device. The method of claim 2,
Further comprising displaying biometric information received from the wearable device
How to operate the video display device. The method of claim 1,
The biometric information is
Including at least one of the user's heart rate, blood pressure, and body temperature,
The momentum information is
Including at least one of the number of times the user's walking, exercise time, and strength exercise
How to operate the video display device. The method of claim 1,
The questionnaire is
A plurality of question items related to the recognized content, and
Including a plurality of options for answering each of the plurality of question items
How to operate the video display device. In the video display device,
A display unit; And
Recognizes content using an automatic content recognition technique, and when the number of uses of the recognized content is greater than or equal to a threshold, the display unit controls the display to display a questionnaire for health care services, and the user's body is displayed on the displayed questionnaire. Receiving a setting input for setting information, exercise amount information, and a collection period of the biometric information and exercise amount information, and comprising a control unit for providing the health management service based on the received setting input
Video display device. The method of claim 7,
Further comprising a linkage module for transmitting a setting result according to the setting input to a wearable device, and receiving biometric information and exercise amount information collected by the wearable device during the collection period,
The control unit
Receiving the health management service from a health care server based on at least one of the received biometric information and exercise amount information
Video display device. The method of claim 8,
The above health care service
Including an exercise prescription and a recommended diet generated based on at least one of the biometric information and the exercise amount information
Video display device. The method of claim 8,
The control unit
Controlling the display unit to display biometric information received from the wearable device
Video display device. The method of claim 7,
The biometric information is
Including at least one of the user's heart rate, blood pressure, and body temperature,
The momentum information is
Including at least one of the number of times the user's walking, exercise time, and strength exercise
Video display device. The method of claim 7,
The questionnaire is
A plurality of question items related to the recognized content, and
Including a plurality of options for answering each of the plurality of question items
Video display device.

Images