[go: up one dir, main page]

FR3090256B1 - A method of reproducing on a terminal a main content by restoring a secondary content associated with a displayed object, terminal, server, and corresponding computer program - Google Patents

A method of reproducing on a terminal a main content by restoring a secondary content associated with a displayed object, terminal, server, and corresponding computer program Download PDF

Info

Publication number
FR3090256B1
FR3090256B1 FR1872768A FR1872768A FR3090256B1 FR 3090256 B1 FR3090256 B1 FR 3090256B1 FR 1872768 A FR1872768 A FR 1872768A FR 1872768 A FR1872768 A FR 1872768A FR 3090256 B1 FR3090256 B1 FR 3090256B1
Authority
FR
France
Prior art keywords
terminal
content
server
computer program
reproducing
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
FR1872768A
Other languages
French (fr)
Other versions
FR3090256A1 (en
Inventor
Cédric Floury
Aurore Catteau
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Orange SA
Original Assignee
Orange SA
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Orange SA filed Critical Orange SA
Priority to FR1872768A priority Critical patent/FR3090256B1/en
Publication of FR3090256A1 publication Critical patent/FR3090256A1/en
Application granted granted Critical
Publication of FR3090256B1 publication Critical patent/FR3090256B1/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/013—Eye tracking input arrangements
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
    • H04N21/23418—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving operations for analysing video streams, e.g. detecting features or characteristics
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/422—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • H04N21/4223—Cameras
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H04N21/4312—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
    • H04N21/4316—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations for displaying supplemental content in a region of the screen, e.g. an advertisement in a separate window
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H04N21/44008—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/442—Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk
    • H04N21/44213—Monitoring of end-user related data
    • H04N21/44218—Detecting physical presence or behaviour of the user, e.g. using sensors to detect if the user is leaving the room or changes his face expression during a TV program
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
    • H04N21/4722—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for requesting additional data associated with the content
    • H04N21/4725—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for requesting additional data associated with the content using interactive regions of the image, e.g. hot spots
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/65—Transmission of management data between client and server
    • H04N21/658—Transmission by the client directed to the server
    • H04N21/6587—Control parameters, e.g. trick play commands, viewpoint selection

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • General Engineering & Computer Science (AREA)
  • Databases & Information Systems (AREA)
  • Human Computer Interaction (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Social Psychology (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Marketing (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Business, Economics & Management (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

Procédé de reproduction sur un terminal d’un contenu principal en restituant un contenu secondaire associé à un objet affiché, terminal, serveur, et programme d’ordinateur correspondants. La présente invention concerne un procédé de reproduction, sur un terminal, d’un contenu multimédia enrichi comportant les étapes suivantes : réception (3.1) d’un flux multimédia et affichage (3.2) sur un écran du terminal d’un contenu visuel dit « principal" extrait de ce flux multimédia, détermination (3.4) à l’aide d’une caméra d’une zone de l’écran dite « zone d’intérêt » sur laquelle se porte le regard du spectateur, identification (3.5) dans la zone d’intérêt, d’au moins un objet visuel du contenu visuel affiché, obtention (3.6) d’un contenu audio et/ou visuel dit « secondaire » associé à l’objet visuel identifié, restitution (3.7) du contenu audio ou vidéo secondaire sur l’écran du terminal, en même temps que la reproduction d’une partie au moins du contenu principal. L’invention concerne également le terminal, le serveur, et programme d’ordinateur correspondant, aptes à mettre en œuvre le procédé. FIGURE 3A method of reproducing primary content on a terminal by rendering secondary content associated with a corresponding displayed object, terminal, server, and computer program. The present invention relates to a method for reproducing, on a terminal, an enriched multimedia content comprising the following steps: reception (3.1) of a multimedia stream and display (3.2) on a screen of the terminal of a visual content called " main "extract from this multimedia stream, determination (3.4) using a camera of an area of the screen called the" area of interest "on which the viewer's gaze is focused, identification (3.5) in the area of interest, of at least one visual object of the displayed visual content, obtaining (3.6) of so-called “secondary” audio and / or visual content associated with the identified visual object, restitution (3.7) of the audio content or secondary video on the screen of the terminal, at the same time as the reproduction of at least part of the main content. The invention also relates to the terminal, the server, and the corresponding computer program, capable of implementing the method . FIGURE 3

FR1872768A 2018-12-12 2018-12-12 A method of reproducing on a terminal a main content by restoring a secondary content associated with a displayed object, terminal, server, and corresponding computer program Active FR3090256B1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
FR1872768A FR3090256B1 (en) 2018-12-12 2018-12-12 A method of reproducing on a terminal a main content by restoring a secondary content associated with a displayed object, terminal, server, and corresponding computer program

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
FR1872768A FR3090256B1 (en) 2018-12-12 2018-12-12 A method of reproducing on a terminal a main content by restoring a secondary content associated with a displayed object, terminal, server, and corresponding computer program

Publications (2)

Publication Number Publication Date
FR3090256A1 FR3090256A1 (en) 2020-06-19
FR3090256B1 true FR3090256B1 (en) 2021-07-02

Family

ID=66641038

Family Applications (1)

Application Number Title Priority Date Filing Date
FR1872768A Active FR3090256B1 (en) 2018-12-12 2018-12-12 A method of reproducing on a terminal a main content by restoring a secondary content associated with a displayed object, terminal, server, and corresponding computer program

Country Status (1)

Country Link
FR (1) FR3090256B1 (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
FR3117714A1 (en) * 2020-12-15 2022-06-17 Orange Server, method for processing a video by the server, terminal, and method implemented by the terminal to enrich the video with an object

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8493390B2 (en) * 2010-12-08 2013-07-23 Sony Computer Entertainment America, Inc. Adaptive displays using gaze tracking
US9996150B2 (en) * 2012-12-19 2018-06-12 Qualcomm Incorporated Enabling augmented reality using eye gaze tracking
US8854447B2 (en) * 2012-12-21 2014-10-07 United Video Properties, Inc. Systems and methods for automatically adjusting audio based on gaze point
US9143880B2 (en) * 2013-08-23 2015-09-22 Tobii Ab Systems and methods for providing audio to a user based on gaze input

Also Published As

Publication number Publication date
FR3090256A1 (en) 2020-06-19

Similar Documents

Publication Publication Date Title
US10616665B1 (en) Automated video logging methods and systems
US10200748B2 (en) System and method for commercial detection in digital media environments
US9357261B2 (en) Methods and apparatus to measure exposure to streaming media
US9191422B2 (en) Processing of social media for selected time-shifted multimedia content
CN100563335C (en) Classified content auditing terminal system
CN104462375B (en) Search processing method based on barrage media and system
US20160316233A1 (en) System and method for inserting, delivering and tracking advertisements in a media program
US8826325B2 (en) Automated unobtrusive ancilliary information insertion into a video
EA201700222A3 (en) METHOD FOR PROVIDING INFORMATION DURING A PAUSE WHEN SEEING A VIDEO OR SEEING A IMAGE
CN105848001A (en) Video playback control method and video playback control device
AU2014259879B2 (en) Interactive viewing experiences by detecting on-screen text
WO2012019163A3 (en) Identifying visual media content captured by camera-enabled mobile device
EP2954693A1 (en) Processing of social media for selected time-shifted multimedia content
KR20090067994A (en) Digital TV Broadcasting System, Digital TV and Control Method
CN109644291B (en) System for synchronizing auxiliary data to content including audio
Lasecki et al. Helping students keep up with real-time captions by pausing and highlighting
US20140047483A1 (en) System and Method for Providing Additional Information Associated with an Object Visually Present in Media
CN115244939B (en) System and method for data stream synchronization
EP3598371A1 (en) Device and method for processing a digital video
JP2010098730A (en) Link information providing apparatus, display device, system, method, program, recording medium, and link information transmitting/receiving system
FR3090256B1 (en) A method of reproducing on a terminal a main content by restoring a secondary content associated with a displayed object, terminal, server, and corresponding computer program
KR20100105596A (en) A method of determining a starting point of a semantic unit in an audiovisual signal
Ziegler et al. On time or not on time: A user study on delays in a synchronised companion-screen experience
US9832538B2 (en) Synchronizing broadcast timeline metadata
Ameri et al. Insights into Iranian younger audience of Persian amateur subtitling: a reception study

Legal Events

Date Code Title Description
PLFP Fee payment

Year of fee payment: 2

PLSC Publication of the preliminary search report

Effective date: 20200619

PLFP Fee payment

Year of fee payment: 3

PLFP Fee payment

Year of fee payment: 4

PLFP Fee payment

Year of fee payment: 5

PLFP Fee payment

Year of fee payment: 6

PLFP Fee payment

Year of fee payment: 7