WO2023095474A1

WO2023095474A1 - Information processing device, information processing method, and program

Info

Publication number: WO2023095474A1
Application number: PCT/JP2022/038007
Authority: WO
Inventors: 洋平福馬; 郁男山野
Original assignee: ソニーグループ株式会社
Priority date: 2021-11-24
Filing date: 2022-10-12
Publication date: 2023-06-01

Abstract

[Problem] To effectively heighten the content understanding of a content viewer. [Solution] Provided is an information processing device that includes a control unit for controlling the presentation of content to a content viewer, the control unit exercising control so that the content is converted in accordance with a cognitive characteristic that pertains to information recognition of the content viewer and the content after conversion is presented to the content viewer.

Description

Information processing device, information processing method, and program

The present disclosure relates to an information processing device, an information processing method, and a program.

In recent years, various contents have been created and provided. Techniques for assisting users who view content have also been proposed. For example, Patent Literature 1 discloses a technique for adjusting content according to the physical characteristics of a user viewing the content.

JP-A-2005-56151

However, since the physical characteristics disclosed in Patent Document 1 are limited, the effects achieved by the technology disclosed in Patent Document 1 are also limited. Moreover, it is difficult for the technology disclosed in Patent Literature 1 to deal with characteristics that the user himself/herself does not understand.

According to an aspect of the present disclosure, a control unit that controls presentation of content to a content viewer is provided, and the control unit converts content according to cognitive characteristics that are characteristics related to information recognition of the content viewer. Then, an information processing apparatus is provided that controls so that the content after conversion is presented to the content viewer.

Further, according to another aspect of the present disclosure, the processor controls presentation of content to a content viewer, and the controlling includes cognitive characteristics that are characteristics related to information cognition of the content viewer. A method for information processing is provided, further comprising converting content in response and controlling presentation of the converted content to the content viewer.

Further, according to another aspect of the present disclosure, the computer includes a control unit that controls presentation of content to a content viewer, and the control unit includes a cognitive characteristic that is a characteristic related to information recognition of the content viewer. A program is provided for functioning as an information processing device that converts content in response to the content and controls that the content after conversion is presented to the content viewer.

1 is a diagram for explaining an overview of an embodiment of the present disclosure; FIG. It is a block diagram which shows the structural example of the system 1 which concerns on the same embodiment. FIG. 10 is a diagram showing an example of content conversion for content viewers who are linguistically dominant according to the same embodiment; FIG. 10 is a diagram showing an example of content conversion for content viewers who are auditory dominant according to the embodiment; FIG. 10 is a diagram showing an example of content conversion for a visually dominant content viewer according to the embodiment; FIG. 10 is a diagram showing an example of content conversion for content viewers who are linguistically dominant according to the same embodiment; FIG. 7 is a diagram for explaining content conversion when the content viewer is driving according to the embodiment; 9 is a flow chart showing an example of the control flow of content change according to cognitive characteristics according to the same embodiment. FIG. 5 is a diagram for explaining an example of content conversion according to the language skill of a content viewer according to the embodiment; FIG. 5 is a diagram for explaining an example of content conversion according to the language skill of a content viewer according to the embodiment; FIG. 5 is a diagram for explaining an example of content conversion according to the language skill of a content viewer according to the embodiment; 9 is a flowchart showing an example of the control flow of content conversion according to the language skill of the content viewer according to the same embodiment. FIG. 4 is a diagram for explaining recommendation of content that matches the cognitive characteristics of a content viewer according to the embodiment; FIG. 5 is a diagram for explaining content recommendation based on evaluations of other users having similar cognitive characteristics to the content viewer according to the embodiment; 6 is a flow chart showing an example of the flow of content recommendation according to the cognitive characteristics of content viewers according to the same embodiment. FIG. 10 is a diagram for explaining presentation control of content search results based on the cognitive characteristics of content viewers according to the embodiment; 2 is a block diagram showing a hardware configuration example of an information processing device 90 according to an embodiment of the present disclosure; FIG.

Preferred embodiments of the present disclosure will be described in detail below with reference to the accompanying drawings. In the present specification and drawings, constituent elements having substantially the same functional configuration are denoted by the same reference numerals, thereby omitting redundant description.

Note that the description will be given in the following order.
1. Embodiment 1.1. Overview 1.2. System configuration example 1.3. Conversion example of presentation content 1.4. Content Conversion Related to Foreign Language Recognition 1.5. Content recommendation control based on cognitive characteristics 2 . Hardware configuration example 3 . summary

<1. embodiment>
<<1.1. Overview＞＞
First, an outline of an embodiment of the present disclosure will be described.

In recent years, many users are using personal computers, smartphones, tablets, etc. to view various contents.

On the other hand, even when viewing the same content, there will be differences in the degree of understanding and the fixation of memory depending on the user.

One of the above factors is that the cognitive characteristics, which are the characteristics related to information recognition, differ depending on the user.

As an example, we classify human cognitive characteristics into three categories: visual superiority, which is superior in recognizing visual information; auditory superiority, which is superior in recognizing visual information; and linguistic superiority, which is superior in recognizing verbal information. There is a known method for

People who are visually dominant tend to understand and remember visual information such as images easily, but they may have poor comprehension of auditory and verbal information.

People with superior hearing tend to understand and remember auditory information such as voice easily, but they may have poor comprehension of visual and verbal information.

People who are linguistically dominant tend to understand and remember linguistic information such as texts easily, but they may have poor comprehension of visual and auditory information.

The cognitive characteristics listed above are said to be possessed by all people, and are not limited to specific attributes (eg age, gender, etc.).

For this reason, if the cognitive characteristics of users who view content (hereinafter referred to as content viewers) do not match the details of the content, a situation may arise in which it is difficult for the content viewers to understand the content.

For example, if the content lacks visual information and is created with a large amount of auditory and linguistic information, content viewers who are visually dominant may find it difficult to understand the contents of the content and may not be able to maintain their concentration. Sometimes.

Also, for example, if the content lacks auditory information and is created by including a large amount of visual information and linguistic information, it is difficult for the content viewer, who is primarily auditory, to understand the contents of the content and to maintain concentration. may occur.

In addition, for example, if the content lacks linguistic information and is created by including a large amount of visual and auditory information, the content viewer who is linguistically dominant may find it difficult to understand the contents of the content and may not be able to maintain concentration. may occur.

The situation described above can occur when content is not created with consideration given to the cognitive characteristics of content viewers. However, very high costs are required to manually edit the contents of the content for each content viewer.

The technical idea according to one embodiment of the present disclosure was conceived with a focus on the above points, and effectively enhances the content viewer's understanding of the content.

For this reason, an information processing apparatus that implements an information processing method according to an embodiment of the present disclosure converts content according to cognitive characteristics, which are characteristics related to information recognition of content viewers, and converts the content after conversion to the One of the features is to control the content to be presented to the viewer.

FIG. 1 is a diagram for explaining an overview of one embodiment of the present disclosure.

The upper part of FIG. 1 shows a radar chart showing the scores of each dominant type in the cognitive characteristics of the content viewer A1a. The score as described above may be obtained, for example, from a preliminary test or the like. Referring to the radar chart, the content viewer A1a can be considered to be visually dominant since the score for visual superiority is the highest.

On the other hand, the lower part of FIG. 1 shows a radar chart showing the scores of each dominant type in the cognitive characteristics of the content viewer A1b. Referring to the radar chart, content viewer A1b can be considered to be linguistically dominant because the language superiority score is the highest.

In such a case, the information processing apparatus according to the present embodiment may convert content so that information that is easy for the content viewer to recognize increases in the content according to the cognitive characteristics of the content viewer.

More specifically, the information processing apparatus according to the present embodiment converts the content so as to increase the visual information in the content based on the fact that the content viewer A1a is visually dominant, and the converted content C1a is The content is controlled to be presented to the content viewer A1a.

On the other hand, the information processing apparatus according to the present embodiment converts the content so as to increase language information in the content based on the fact that the content viewer A1b is linguistically dominant. to be presented to

On the other hand, the information processing apparatus according to the present embodiment may convert the content so that auditory information in the content is increased when the content viewer has superior auditory sense.

According to the above-described control, it is possible to provide content according to the cognitive characteristics of each content viewer, thereby effectively enhancing the content viewer's understanding of the content.

<<1.2. System configuration example >>
A configuration example for realizing the above control will be described in detail below.

FIG. 2 is a block diagram showing a configuration example of the system 1 according to this embodiment. As shown in FIG. 2 , the system 1 according to this embodiment includes an information processing server 10 and user terminals 20 . Also, the information processing server 10 and the user terminal 20 are connected via a network 30 .

(Information processing server 10)
The information processing server 10 according to the present embodiment is an example of an information processing apparatus that controls presentation of content to content viewers.

As shown in FIG. 2, the information processing server 10 according to this embodiment may include a control unit 110, a storage unit 120, and a communication unit .

(control unit 110)
The control unit 110 according to the present embodiment controls each component included in the information processing server 10 and the user terminal 20 .

For example, the control unit 110 according to the present embodiment controls presentation of content to content viewers by the user terminal 20 .

The control unit 110 according to the present embodiment converts content according to cognitive characteristics, which are characteristics related to information recognition of content viewers, and controls the user terminal 20 so that the content after conversion is presented to the content viewers. It is one of the characteristics.

The control unit 110 according to this embodiment is realized by various processors. The details of the functions of the control unit 110 will be described later.

(storage unit 120)
The storage unit 120 according to the present embodiment stores various types of information used by each configuration included in the information processing server 10 .

The storage unit 120 according to the present embodiment stores, for example, information related to content, cognitive characteristics of content viewers, cognitive characteristics of content creators, tests for determining cognitive characteristics, and the like.

(Communication unit 130)
The communication unit 130 according to this embodiment performs information communication with the user terminal 20 via the network 30 .

For example, the communication unit 130 according to this embodiment receives various information acquired by the user terminal 20 . Also, for example, the communication unit 130 transmits a control signal generated by the control unit 110, converted content, and the like to the user terminal 20. FIG.

Also, the communication unit 130 according to the present embodiment may perform information communication with an external server installed for the content providing service.

(User terminal 20)
The user terminal 20 according to this embodiment is a terminal that presents content to content viewers. The user terminal 20 according to this embodiment may be, for example, a personal computer, a smart phone, a tablet, or the like.

As shown in FIG. 2, the user terminal 20 according to this embodiment may include a control unit 210, an operation unit 220, a presentation unit 230, an imaging unit 240, a storage unit 250, and a communication unit 260.

(control unit 210)
The control unit 210 according to this embodiment controls each configuration included in the user terminal 20 .

For example, the control unit 210 according to the present embodiment may control content presentation by the presentation unit 230 based on content, control signals, etc. received from the information processing server 10 .

On the other hand, the user terminal 20 according to this embodiment may operate as an information processing device having the content conversion function as described above. In this case, the control unit 210 may have content conversion as described above.

Content conversion according to the present embodiment may be realized by either the information processing server 10 or the user terminal 20, or by cooperation of both.

The control unit 210 according to this embodiment is realized by various processors.

(Operation unit 220)
The operation unit 220 according to this embodiment receives an operation by the user. For this purpose, the operation unit 220 according to this embodiment includes a keyboard, mouse, buttons, switches, and the like.

(Presentation unit 230)
The presenting unit 230 according to the present embodiment presents content to content viewers. For this reason, the presentation unit 230 according to this embodiment includes various displays, speakers, and the like.

(Photographing unit 240)
The imaging unit 240 according to this embodiment captures an image of the content viewer. The image captured by the capturing unit 240 according to this embodiment can be used to determine the cognitive characteristics of the content viewer.

(storage unit 250)
The storage unit 250 according to this embodiment stores various types of information used by each configuration of the user terminal 20 .

(Communication unit 260)
The communication unit 260 according to this embodiment performs information communication with the information processing server 10 via the network 30 .

For example, the communication unit 260 according to the present embodiment transmits various types of information acquired by each component of the user terminal 20 to the information processing server 10 . Also, for example, the communication unit 260 receives a control signal, converted content, and the like from the information processing server 10 .

Also, the communication unit 260 according to the present embodiment may perform information communication with an external server installed for the content providing service.

The configuration example of the system 1 according to this embodiment has been described above. Note that the above configuration described using FIG. 2 is merely an example, and the configuration of the system 1 according to the present embodiment is not limited to this example. The configuration of the system 1 according to this embodiment can be flexibly modified according to specifications and operations.

<<1.3. Presentation content conversion example >>
Next, the content conversion according to the present embodiment will be described with a specific example.

Contents according to the present embodiment include, for example, various presentation contents.

The information contained in presentation content is expected to be strongly influenced by the cognitive characteristics of the content creator.

For example, if the content creator is visually dominant, it is expected that the presentation content will contain a lot of visual information.

On the other hand, if the content creator is auditory, it is expected that the presentation content will contain a lot of auditory information.

On the other hand, if the content creator is linguistically dominant, the presentation content is expected to contain a lot of linguistic information.

However, if the cognitive characteristics of the content creator and the cognitive characteristics of the content viewer do not match, it may be difficult for the content viewer to understand the presentation content.

In order to solve the above situation, the control unit 110 of the information processing server 10 according to the present embodiment may convert content according to the cognitive characteristics of the content creator and the content viewer.

First, an example of converting presentation content (hereinafter simply referred to as content) created by a content creator who is auditory dominant for a content viewer who is linguistically dominant will be described.

FIG. 3 is a diagram showing an example of content conversion for content viewers with language predominance according to the present embodiment.

The upper part of FIG. 3 illustrates content C2a created by a content creator who has superior hearing.

Here, it is assumed that the content C2a does not have a specific explanation using linguistic information, and the presenter P2 (who may be the same person as the content creator) mainly gives a detailed explanation through verbal utterances COM2. .

In this case, it may be difficult for the content viewer who is linguistically dominant to understand the contents of the content C2a.

In order to solve the above problem, as shown in the lower part of FIG. 3, the control unit 110 generates a content C2b by adding a text T2b corresponding to the content of the utterance COM2 to the content C2a. may control the user terminal 20 to present the

Note that the control unit 110 may use the text T2b pre-stored in the storage unit 120. In this case, the content creator may send information such as the text T2b necessary for conversion to each dominant type to the information processing server 10 in advance.

On the other hand, the control unit 110 can also generate the text T2b by recognizing the speech COM2. In this way, content conversion according to the present embodiment may be processed dynamically.

Next, an example of converting content created by a content creator who is linguistically dominant for content viewers who are auditory dominant will be described.

FIG. 4 is a diagram showing an example of content conversion for content viewers with superior hearing according to the present embodiment.

The upper part of FIG. 4 illustrates the content C3a created by the content creator who is linguistically dominant.

Here, it is assumed that the content C3a does not contain audio information and consists only of visual information and language information.

In this case, it may be difficult for the content viewer who has superior hearing to understand the contents of the content C3a.

In order to solve the above problem, as shown in the lower part of FIG. 4, the control unit 110 generates content C3b by adding corresponding audio VS3b to the text included in content C3a, and the content C3b is presented to the content viewer. User terminal 20 may be controlled to be presented.

The voice VS3b may be stored in the storage unit 120 in advance, or may be dynamically generated by synthesizing the text contained in the content C3a.

Next, an example of converting content C3a created by a content creator who is linguistically dominant for a content viewer who is visually dominant will be described.

FIG. 5 is a diagram showing an example of content conversion for visually dominant content viewers according to the present embodiment.

The upper part of FIG. 5 shows the same content C3a as shown in the upper part of FIG.

Although content C3a includes graphs, which are visual information, it also contains a large amount of linguistic information (text), which may lead to a decline in the understanding and concentration of content viewers who are visually dominant.

In order to solve the above problem, as shown in the lower part of FIG. 5, the control unit 110 enlarges the graph, which is the visual information, and emphasizes the corresponding explanation part, and replaces the original language information with the original language information. may be generated and the user terminal 20 may be controlled to present the content C3c to the content viewer.

The summary language information SL3c may be stored in advance in the storage unit 120, or may be generated by subjecting the text included in the content C3a to text summary processing using a natural language processing model.

FIGS. 4 and 5 exemplify the case where the content C3a created by the linguistically dominant content creator is converted for auditory dominant content viewers and visual dominant content viewers, respectively.

On the other hand, it is also conceivable that there are content viewers who have the same level of auditory superiority and visual superiority. In this case, the control unit 110 may generate content by adding the audio VS3b shown in FIG. 4 to the content C3c shown in FIG.

Next, an example of converting content created by a visually dominant content creator for a linguistically dominant content viewer will be described.

FIG. 6 is a diagram showing an example of content conversion for content viewers with language predominance according to the present embodiment.

The upper part of FIG. 6 illustrates content C4a created by a content creator who is visually dominant.

Here, it is assumed that photographs are used extensively in content C2a, and detailed explanations are given verbally.

In this case, it may be difficult for a content viewer who is linguistically dominant and whose auditory superiority level is low to understand the contents of the content C4a.
In order to solve the above problem, as shown in the lower part of FIG. 6, the control unit 110 generates content C4b by adding text T4b corresponding to the oral explanation to the content C4a, and presents the content C4b to the content viewer. You may control the user terminal 20 so that it may be performed.

As described above, the text T4b may be stored in advance in the storage unit 120, or may be generated by voice recognition.

In the above, we have given specific examples of content conversion based on the cognitive characteristics of content creators and the cognitive characteristics of content viewers.

Note that the cognitive characteristics of the content creator and the cognitive characteristics of the content viewer may be determined by tests conducted in advance, or may be set by the content creator or the content viewer.

On the other hand, the control unit 110 can also dynamically determine the cognitive characteristics of content viewers and the like.

An image of the content viewer captured by the imaging unit 240 of the user terminal 20 may be used for the above determination.

More specifically, the control unit 110 may detect the line of sight of the content viewer using the above image, and determine the cognitive characteristics of the content viewer based on the result.

For example, if the content viewer's line of sight is focused on visual information such as a graph in the content, the control unit 110 may determine that the content viewer is visually dominant.

Also, for example, when the content viewer's line of sight is focused on language information such as text in the content, the control unit 110 may determine that the content viewer is linguistically dominant.

Further, for example, when the content viewer's line of sight is not concentrated on a specific part in the content, when the same line of sight is not on the screen where the content is displayed, when the content viewer closes his/her eyes, etc. It may be determined that the content viewer is hearing dominant.

Furthermore, the cognitive characteristics of content viewers are not necessarily static, but can be considered to change according to the environment.

FIG. 7 is a diagram for explaining content conversion when the content viewer is driving according to the present embodiment.

The upper part of FIG. 7 shows an example in which the content C5a displayed on the presentation unit 230 does not contain auditory information, but largely contains visual information and linguistic information.

Since it is generally difficult to gaze at the presentation unit 230 while driving, in such a situation, it can be assumed that the content viewer becomes auditory dominant regardless of the original superiority type. It is possible.

For this reason, as shown in the lower part of FIG. 7, the control unit 110 may delete the language information that is particularly difficult to read from the content C5a and add the voice VS5b corresponding to the language information to generate the content C5b. good.

According to the above control, it is possible to present content according to cognitive characteristics that change according to the environment.

Another example of content conversion according to the environment is converting auditory information into linguistic information when the audio output of the user terminal is muted on a train or the like.

Next, the flow of control for content change according to cognitive characteristics according to this embodiment will be described.

FIG. 8 is a flow chart showing an example of the control flow for content change according to cognitive characteristics according to this embodiment.

In the example shown in FIG. 8, the control unit 110 first acquires the cognitive characteristics of the content viewer (S102).

Next, the control unit 110 acquires the cognitive characteristics of the content creator (S104).

As described above, the control unit 110 may acquire the cognitive characteristics of content viewers or content creators from pre-stored information, or may dynamically determine them.

Next, the control unit 110 changes the content based on the content viewer's cognitive characteristics acquired in step S102 and the content creator's cognitive characteristics acquired in step S104 (S106).

At this time, the control unit 110 may use information prepared in advance for the conversion, or may dynamically convert the information.

Next, the control unit 110 controls the user terminal 20 so that the content converted in step S106 is presented to the content viewer (S108).

In the above, the flow of content change control according to intelligence characteristics according to the present embodiment has been described. Note that the flow described above with reference to FIG. 8 is merely an example.

For example, the control unit 110 does not necessarily have to use the cognitive characteristics of the content creator. By increasing the number of information components that match the cognitive characteristics of content viewers, it is expected that the understanding of content viewers will increase, regardless of the cognitive characteristics of content creators.

On the other hand, the control unit 110 can also perform content conversion based on the cognitive characteristics of the content creator without using the cognitive characteristics of the content creator.

In this case, the control unit 110 may, for example, perform content conversion so as to reduce the number of information components that match the cognitive characteristics of the content creator (if the content creator is linguistically dominant, the text is converted into voice). etc).

According to the above control, the amounts of visual information, auditory information, and language information are equalized, and content that can be understood by an unspecified number of content viewers can be created.

In the above, an example of applying the system 1 mainly to one-way information transmission (contents) such as presentations has been described. However, application of the system 1 according to this embodiment is not limited to the above example.

The system 1 according to this embodiment can also be used for two-way communication using a plurality of user terminals 20, for example.

The above two-way communication includes, for example, meetings and lectures using online communication tools.

In the following, we will take as an example a case where one lecturer gives a lecture including interactive exchanges to multiple students at a school or cram school.

In this case, content conversion may be carried out based on each cognitive characteristic obtained from an evaluation test conducted in advance for both the instructor and the student.

More specifically, content conversion can be performed based on matching of cognitive characteristics between a teacher (content creator) who sends information such as blackboard notes and teaching materials to students and a student (content viewer) who receives them. good.

Content conversion may be performed by any of the user terminal 20 used by the lecturer who is the content creator, the information processing server 10, and the user terminal 20 used by the student who is the content viewer.

For example, for visually dominant students, the voice of the lecturer's explanation is visually converted into text and displayed superimposed on the teaching materials and information on the blackboard. At this time, in order to determine the position where the text information is displayed, information on the degree of matching between the spoken text information and the text information in the teaching material may be used. Alternatively, the line-of-sight information of the lecturer may be used for superimposing the information as described above.

On the other hand, when a lecturer utters a sentence in the teaching material, instead of converting the utterance into text as described above, the relevant part of the teaching material is emphasized according to the utterance (for example, , underlining, etc.), control may be performed to make it easier to obtain information visually according to the progress of the lesson.

Also, for example, in a social studies class, if the information in the teaching materials includes the name of a historical figure, by superimposing a photo or portrait of that person on the display, the class can be taught to visually dominant students. Content transformations are also possible to make information easier to remember.

In addition, for visually dominant students, control is performed so that all or part of the auditory information such as the lecturer's speech does not reach the students, and control is performed to suppress the volume of the user terminal 20 used by the students. may Such control is expected to have the effect of making it easier for students to concentrate on visual information by reducing the amount of auditory information.

In addition, when students take actions such as asking questions to the instructor in a lecture, it is important to indicate to the instructor what kind of audiovisual information the student is presenting. As a method to realize this, for example, there is a method of presenting a list of screen images that the student can see or is writing on together with a list of camera images of the student side to the lecturer. A possible method is to share the video of the students performing the lecture with all the lecture participants.

In the above, an example of obtaining the cognitive characteristics of instructors and students through prior evaluation tests, etc. was described, but this is only an example. Another method of acquiring the cognitive characteristics of the lecturer and the students is to determine which modal the user (lecturer/student) is mainly based on, for example, the relationship between the gaze movements and utterances of both the lecturer and the students during the lecture. Methods for determining whether information is being obtained (what cognitive characteristics) are also included.

Cognitive characteristics acquired by various methods may be used for content conversion in real-time lectures as described above, and recommendation of video lesson content and teaching materials (for offline use) that suits each student's characteristics. , it may be used for matching with cram school instructors who are compatible with each other in terms of cognitive characteristics and teaching style.

<<1.4. Content conversion related to foreign language recognition>>
An example of content conversion when the cognitive characteristics according to the present embodiment include the three superiority types of visual superiority, auditory superiority, and verbal superiority has been described above. However, the cognitive characteristics according to this embodiment are not limited to the above examples.

　When defining cognitive characteristics as being able to understand and memorize presented information, language skills related to the recognition of foreign languages can also be considered as a type of cognitive characteristics.

Therefore, the control unit 110 according to the present embodiment may convert content according to the language skill of the content viewer.

Examples of the above language skills include reading skills related to reading foreign languages and listening skills related to listening to foreign languages.

An example in which the control unit 110 according to the present embodiment sets subtitles for video content according to the language skill of the content viewer will be described below.

9 to 11 are diagrams for explaining an example of content conversion according to the language skill of the content viewer according to this embodiment.

FIG. 9 illustrates a situation in which a content viewer A6a whose reading skill and listening skill are both below a predetermined level watches video content with foreign language audio.

In this case, it is difficult for the content viewer A6a to understand the video content only with the foreign language audio included in the original video content.

For this purpose, control unit 110 generates content C6a by adding foreign language subtitles T6e and content viewer's native language subtitles T6j to the original video content, and presents content C6a to content viewer A6a. may be controlled.

On the other hand, FIG. 10 illustrates a situation in which content viewer A6b whose reading skill exceeds a predetermined level but whose listening skill is below a predetermined level watches video content with foreign language audio.

Also in this case, it is difficult for the content viewer A6b to understand the video content only with the foreign language audio included in the original video content.

On the other hand, since the content viewer A6b has a reading skill above a predetermined level, there is a possibility that he/she can understand the content of the video content only with the foreign language subtitles T6e. Also, in recent years, native language subtitles T6j may be generated by automatic translation using AI, and translation accuracy may not be sufficient.

For this reason, the control unit 110 may generate content C6b by adding foreign language subtitles T6e to the original video content, and control so that the content C6b is presented to the content viewer A6b.

Also, the language skill according to this embodiment may include vocabulary.

FIG. 11 illustrates a situation in which content viewer A6c whose reading skill exceeds a predetermined level but whose vocabulary is below a predetermined level watches video content with foreign language audio.

In this case, it may be difficult for the content viewer A6c to understand the video content only with the foreign language subtitles T6e, while presenting the native language subtitles T6j may reduce the comprehension and concentration of the content viewer A6c. There is also the possibility of

Therefore, the control unit 110 generates the content C6c by adding the foreign language subtitles T6e and the auxiliary information AI6 indicating the meaning of words, etc. exceeding the vocabulary level of the content viewer A6c to the original video content. may be controlled to be presented to the content viewer A6c.

Above, with reference to FIGS. 9 and 10, a specific example of content conversion according to the language skill of the content viewer has been described.

Next, the flow of content conversion control according to the content viewer's language skill according to this embodiment will be described.

FIG. 12 is a flowchart showing an example of the control flow of content conversion according to the language skill of the content viewer according to this embodiment.

In the example shown in FIG. 12, the control unit 110 first acquires the language skill of the content viewer (S202).

For example, the control unit 110 may use information stored in advance in the storage unit 120 (information related to foreign language-related qualifications possessed by the content viewer, foreign language test scores, etc.), or may use information on a test performed before content viewing. The language skill of the content viewer may be determined based on the result of .

Next, the control unit 110 acquires the language skill (recommended skill level) recommended for viewing content (S204).

Next, the control unit 110 sets subtitles, etc. based on the content viewer's language skill acquired in step S202 and the recommended skill level acquired in step S204 (S206).

Next, the control unit 110 controls the user terminal 20 so that the content including the subtitles set in step S206 is presented to the content viewer (S208).

Note that if the user terminal 20 is a head-mounted wearable device, the control unit 110 can also control so that subtitles and the like are presented according to each of a plurality of content viewers viewing the same content at the same time. is.

An example of the flow of content conversion control according to the content viewer's language skill has been described above.

In the above description, the case where the control unit 110 performs content conversion for the purpose of assisting the content viewer's understanding is exemplified.

On the other hand, the control unit 110 may perform content conversion for content viewers to learn foreign languages.

For example, the control unit 110 controls to present the content C6c as shown in FIG. 11 to the content viewer A6a whose reading skill and listening skill are both below a predetermined level, thereby increasing the language skill of the content viewer A6a. May encourage reinforcement.

Also, for example, the control unit 110 may say, "Let's review and learn new words from today's content," It is also possible to control presentation of a message such as "Let's see" to encourage the content viewer to study.

<<1.5. Content recommendation control based on cognitive characteristics>>
Next, content recommendation control based on the cognitive characteristics of content viewers according to the present embodiment will be described.

Although the content according to the present embodiment has been described above as presentation content or video content, these are merely examples.

In addition to the above examples, the content according to the present embodiment may include various types of content such as audio content such as podcasts, articles on the Web, learning content, and game content.

In addition, the information processing server 10 according to the present embodiment can acquire information on a wide variety of content as described above from a server installed by a service provider, and recommend it to content viewers.

At this time, the control unit 110 may determine the content to be recommended to the content viewer according to the cognitive characteristics of the content viewer.

For example, the control unit according to the present embodiment may search for content that matches the cognitive characteristics of the content viewer, and recommend the content obtained as the search result to the content viewer.

FIG. 13 is a diagram for explaining the recommendation of content that matches the cognitive characteristics of content viewers according to this embodiment.

FIG. 13 shows an example of recommending content to content viewer A7 who is visually dominant.

In the case of this example, the control unit 110 causes the presentation unit 230 to display a message recommending video content containing a lot of visual information based on the cognitive characteristics of the content viewer A7.

It should be noted that when language skills are used instead of superiority types as cognitive characteristics, the control unit 110 may cause the presentation unit 230 to display a message that recommends content that matches the content viewer's language skills.

Furthermore, the control unit 110 can use both the superiority type and the language skill as cognitive characteristics to recommend content that is useful for content viewers to study foreign countries.

The content useful for the content viewer's foreign study may be, for example, a content whose recommended skill level matches the content viewer's language level and contains a lot of information corresponding to the content viewer's superiority type. .

According to each of the above-mentioned controls, it is possible to increase the possibility that content viewers will be able to view content that matches their own cognitive characteristics.

Also, the control unit 110 according to the present embodiment may recommend to the content viewer content highly rated by other users who have similar cognitive characteristics to the content viewer.

FIG. 14 is a diagram for explaining content recommendation based on evaluations of other users who have similar cognitive characteristics to the content viewer according to this embodiment.

FIG. 14 shows an example of recommending content to content viewer A8 who has superior hearing.

In the case of this example, the control unit 110 causes the presentation unit 230 to display a message recommending podcast content highly rated by other users who have similar cognitive characteristics to the content viewer A8.

Note that when language skill is used as the cognitive characteristic instead of the superiority type, the control unit 110 causes the presentation unit 230 to display a message recommending content highly evaluated by other users who have the same skill level as the language skill of the content viewer. may be displayed in

Furthermore, the control unit 110 uses both the superiority type and the language skill as cognitive characteristics to recommend content highly rated by other users having a characteristic set similar to the superiority type and language skill of the content viewer. It is also possible to

According to each of the above-mentioned controls, it is possible for content viewers to view content that is highly likely to be beneficial to them.

Next, the flow of content recommendation according to the content viewer's cognitive characteristics according to this embodiment will be described.

FIG. 15 is a flowchart showing an example of the flow of content recommendation according to the cognitive characteristics of content viewers according to this embodiment.

In the case of the example shown in FIG. 15, the control unit 110 first acquires the cognitive characteristics of the content viewer (S302).

Next, the control unit 110 searches a plurality of services for content that matches the cognitive characteristics of the content viewer (S304).

Next, the control unit 110 acquires content evaluations of other users who have cognitive characteristics similar to those of the content viewer (S306).

Next, the control unit 110 performs content recommendation control based on either the information acquired in step S304 or the information acquired in step S306, or both (S308).

An example of the content recommendation flow according to the content viewer's cognitive characteristics according to the present embodiment has been described above.

Next, we will discuss presentation control of content search results based on the cognitive characteristics of content viewers.

Here, it is assumed that the content viewer specifies arbitrary search conditions, and the control unit 110 searches for content from servers installed by a plurality of service providers based on the specified search conditions.

　Generally, the order of presentation of the above search results is determined based on the number of accesses. Determining the presentation order of such search results can also be regarded as a type of content recommendation.

However, with the above method, the search results (contents) presented at the top may not match the cognitive characteristics of content viewers, and may not be beneficial for content viewers.

Therefore, the control unit 110 according to the present embodiment searches for content based on search conditions specified by the content viewer, and adjusts the presentation order of a plurality of pieces of content obtained as search results to the cognitive characteristics of the content viewer. may be determined accordingly.

FIG. 16 is a diagram for explaining presentation control of content search results based on the cognitive characteristics of content viewers according to the present embodiment.

FIG. 16 shows an example in which search results based on search keywords are presented as many times as specified by content viewer A9, who is linguistically dominant.

In this example, the control unit 110 performs control so that web articles containing a lot of language information are displayed at the top of the search results based on the cognitive characteristics of the content viewer A9.

Note that when language skills are used instead of superiority types as cognitive characteristics, the control unit 110 may perform control so that content that matches the language skills of the content viewer is ranked higher in the search results.

Furthermore, the control unit 110 can use both the superiority type and the language skill as cognitive characteristics, and control so that the content matching the superiority type and the language skill ranks higher in the search results.

According to each of the above-mentioned controls, it is expected that content viewers will be able to easily obtain content that matches their own cognitive characteristics when searching for content.

<2. Hardware configuration example>
Next, a hardware configuration example common to the information processing server 10 and the user terminal 20 according to an embodiment of the present disclosure will be described. FIG. 17 is a block diagram showing a hardware configuration example of an information processing device 90 according to an embodiment of the present disclosure. The information processing device 90 may be a device having a hardware configuration equivalent to that of the information processing server 10 and the user terminal 20 .

As shown in FIG. 17, the information processing device 90 includes, for example, a processor 871, a ROM 872, a RAM 873, a host bus 874, a bridge 875, an external bus 876, an interface 877, an input device 878, and an output device. 879 , a storage 880 , a drive 881 , a connection port 882 and a communication device 883 . Note that the hardware configuration shown here is an example, and some of the components may be omitted. Moreover, it may further include components other than the components shown here.

(processor 871)
The processor 871 functions as, for example, an arithmetic processing device or a control device, and controls the overall operation of each component or a part thereof based on various programs recorded in the ROM 872, RAM 873, storage 880, or removable storage medium 901. .

(ROM872, RAM873)
The ROM 872 is means for storing programs to be read into the processor 871, data used for calculation, and the like. The RAM 873 temporarily or permanently stores, for example, programs to be read into the processor 871 and various parameters that change appropriately when the programs are executed.

(Host Bus 874, Bridge 875, External Bus 876, Interface 877)
The processor 871, ROM 872, and RAM 873 are interconnected via, for example, a host bus 874 capable of high-speed data transmission. On the other hand, the host bus 874 is connected, for example, via a bridge 875 to an external bus 876 with a relatively low data transmission speed. External bus 876 is also connected to various components via interface 877 .

(input device 878)
For the input device 878, for example, a mouse, keyboard, touch panel, button, switch, lever, or the like is used. Furthermore, as the input device 878, a remote controller (hereinafter referred to as a remote controller) capable of transmitting control signals using infrared rays or other radio waves may be used. The input device 878 also includes a voice input device such as a microphone.

(output device 879)
The output device 879 is, for example, a display device such as a CRT (Cathode Ray Tube), LCD, or organic EL, an audio output device such as a speaker, headphones, a printer, a mobile phone, a facsimile, or the like, and outputs the acquired information to the user. It is a device capable of visually or audibly notifying Output devices 879 according to the present disclosure also include various vibration devices capable of outputting tactile stimuli.

(storage 880)
Storage 880 is a device for storing various data. As the storage 880, for example, a magnetic storage device such as a hard disk drive (HDD), a semiconductor storage device, an optical storage device, a magneto-optical storage device, or the like is used.

(Drive 881)
The drive 881 is, for example, a device that reads information recorded on a removable storage medium 901 such as a magnetic disk, optical disk, magneto-optical disk, or semiconductor memory, or writes information to the removable storage medium 901 .

(Removable storage medium 901)
The removable storage medium 901 is, for example, DVD media, Blu-ray (registered trademark) media, HD DVD media, various semiconductor storage media, and the like. Of course, the removable storage medium 901 may be, for example, an IC card equipped with a contactless IC chip, an electronic device, or the like.

(Connection port 882)
The connection port 882 is, for example, a USB (Universal Serial Bus) port, an IEEE1394 port, a SCSI (Small Computer System Interface), an RS-232C port, or a port for connecting an external connection device 902 such as an optical audio terminal. be.

(External connection device 902)
The external connection device 902 is, for example, a printer, a portable music player, a digital camera, a digital video camera, an IC recorder, or the like.

(Communication device 883)
The communication device 883 is a communication device for connecting to a network. subscriber line) or a modem for various communications.

<3. Summary>
As described above, the information processing apparatus according to an embodiment of the present disclosure includes a control unit that controls presentation of content to content viewers. In addition, one of the characteristics is that the control unit converts the content according to the cognitive characteristics, which are the characteristics related to the information recognition of the content viewer, and controls so that the content after conversion is presented to the content viewer. .

According to the above configuration, it is possible to effectively enhance the content viewer's understanding of the content.

Although the preferred embodiments of the present disclosure have been described in detail above with reference to the accompanying drawings, the technical scope of the present disclosure is not limited to such examples. It is obvious that a person having ordinary knowledge in the technical field of the present disclosure can conceive of various modifications or modifications within the scope of the technical idea described in the claims. are naturally within the technical scope of the present disclosure.

Also, each step related to the processing described in this specification does not necessarily have to be processed in chronological order according to the order described in the flowcharts and sequence diagrams. For example, each step involved in the processing of each device may be processed in an order different from that described, or may be processed in parallel.

Also, a series of processes by each device described in this specification may be realized using any of software, hardware, or a combination of software and hardware. A program that constitutes software is, for example, provided inside or outside each device and stored in advance in a computer-readable non-transitory computer readable medium. Each program, for example, is read into a RAM when executed by a computer, and executed by various processors. The storage medium is, for example, a magnetic disk, an optical disk, a magneto-optical disk, a flash memory, or the like. Also, the above computer program may be distributed, for example, via a network without using a storage medium.

Also, the effects described in this specification are merely descriptive or exemplary, and are not limiting. In other words, the technology according to the present disclosure can produce other effects that are obvious to those skilled in the art from the description of this specification in addition to or instead of the above effects.

Note that the following configuration also belongs to the technical scope of the present disclosure.
(1)
a control unit that controls presentation of content to content viewers;
with
The control unit converts content according to cognitive characteristics, which are characteristics related to information recognition of the content viewer, and controls so that the converted content is presented to the content viewer.
Information processing equipment.
(2)
The control unit converts content in accordance with the cognitive characteristics of the content viewer so that information in the content that is easy for the content viewer to recognize increases.
The information processing device according to (1) above.
(3)
The cognitive traits include visual dominance with a dominance in perceiving visual information, auditory dominance with a dominance in perceiving auditory information, and verbal dominance with a dominance in perceiving verbal information.
The information processing device according to (2) above.
(4)
When the content viewer is visually dominant, the control unit converts the content so that visual information in the content increases.
The information processing device according to (3) above.
(5)
When the content viewer is auditory dominant, the control unit converts the content so as to increase auditory information in the content.
The information processing apparatus according to (3) or (4).
(6)
When the content viewer is linguistically dominant, the control unit converts the content so that language information in the content increases.
The information processing apparatus according to any one of (3) to (5).
(7)
The control unit converts the content according to the cognitive characteristics of the content creator;
The information processing apparatus according to any one of (1) to (6) above.
(8)
The cognitive characteristics include language skills related to foreign language recognition,
The information processing device according to (1) above.
(9)
The control unit converts the content according to the language skill of the content viewer.
The information processing device according to (8) above.
(10)
The language skills include reading skills related to reading foreign languages and listening skills related to listening to foreign languages,
The information processing apparatus according to (8) or (9).
(11)
The control unit sets subtitles for video content according to the language skill of the content viewer.
The information processing device according to (10) above.
(12)
When the reading skill of the content viewer exceeds a predetermined level, the control unit controls so that subtitles in the native language of the content viewer are not presented.
The information processing device according to (11) above.
(13)
The control unit determines content to be recommended to the content viewer according to the cognitive characteristics of the content viewer.
The information processing apparatus according to any one of (1) to (12) above.
(14)
The control unit searches for content that matches the cognitive characteristics of the content viewer, and recommends the content obtained as a search result to the content viewer.
The information processing device according to (13) above.
(15)
The control unit recommends, to the content viewer, content highly rated by other users having the cognitive characteristics similar to that of the content viewer.
The information processing apparatus according to (13) or (14).
(16)
The control unit searches for content based on search conditions specified by the content viewer, and determines the order of presentation of a plurality of pieces of content obtained as search results according to the cognitive characteristics of the content viewer.
The information processing device according to (13) above.
(17)
a processor controlling presentation of content to content viewers;
including
The controlling includes converting content according to cognitive characteristics, which are characteristics related to information recognition of the content viewer, and controlling so that the converted content is presented to the content viewer;
further comprising
Information processing methods.
(18)
the computer,
a control unit that controls presentation of content to content viewers;
with
The control unit converts content according to cognitive characteristics, which are characteristics related to information recognition of the content viewer, and controls so that the converted content is presented to the content viewer.
information processing equipment,
A program to function as

1 system 10 information processing server 110 control unit 120 storage unit 130 communication unit 20 user terminal 210 control unit 220 operation unit 230 presentation unit 240 photographing unit 250 storage unit 260 communication unit

Claims

a control unit that controls presentation of content to content viewers;
with
The control unit converts content according to cognitive characteristics, which are characteristics related to information recognition of the content viewer, and controls so that the converted content is presented to the content viewer.
Information processing equipment.
The control unit converts content in accordance with the cognitive characteristics of the content viewer so that information in the content that is easy for the content viewer to recognize increases.
The information processing device according to claim 1 .
The cognitive traits include visual dominance with a dominance in perceiving visual information, auditory dominance with a dominance in perceiving auditory information, and verbal dominance with a dominance in perceiving verbal information.
The information processing apparatus according to claim 2.
When the content viewer is visually dominant, the control unit converts the content so that visual information in the content increases.
The information processing apparatus according to claim 3.
When the content viewer is auditory dominant, the control unit converts the content so as to increase auditory information in the content.
The information processing apparatus according to claim 3.
When the content viewer is linguistically dominant, the control unit converts the content so that language information in the content increases.
The information processing apparatus according to claim 3.
The control unit converts the content according to the cognitive characteristics of the content creator;
The information processing device according to claim 1 .
The cognitive characteristics include language skills related to foreign language recognition,
The information processing device according to claim 1 .
The control unit converts the content according to the language skill of the content viewer.
The information processing apparatus according to claim 8 .
The language skills include reading skills related to reading foreign languages and listening skills related to listening to foreign languages,
The information processing apparatus according to claim 8 .
The control unit sets subtitles for video content according to the language skill of the content viewer.
The information processing apparatus according to claim 10.
When the reading skill of the content viewer exceeds a predetermined level, the control unit controls so that subtitles in the native language of the content viewer are not presented.
The information processing device according to claim 11 .
The control unit determines content to be recommended to the content viewer according to the cognitive characteristics of the content viewer.
The information processing device according to claim 1 .
The control unit searches for content that matches the cognitive characteristics of the content viewer, and recommends the content obtained as a search result to the content viewer.
The information processing apparatus according to claim 13.
The control unit recommends, to the content viewer, content highly rated by other users having the cognitive characteristics similar to that of the content viewer.
The information processing apparatus according to claim 13.
The control unit searches for content based on search conditions specified by the content viewer, and determines the order of presentation of a plurality of pieces of content obtained as search results according to the cognitive characteristics of the content viewer.
The information processing apparatus according to claim 13.
a processor controlling presentation of content to content viewers;
including
The controlling includes converting content according to cognitive characteristics, which are characteristics related to information recognition of the content viewer, and controlling so that the converted content is presented to the content viewer;
further comprising
Information processing methods.
the computer,
a control unit that controls presentation of content to content viewers;
with
The control unit converts content according to cognitive characteristics, which are characteristics related to information recognition of the content viewer, and controls so that the converted content is presented to the content viewer.
information processing equipment,
A program to function as