[go: up one dir, main page]

WO2018185769A1 - Lecture à démarrage sans à-coups d'éléments multimédia - Google Patents

Lecture à démarrage sans à-coups d'éléments multimédia Download PDF

Info

Publication number
WO2018185769A1
WO2018185769A1 PCT/IL2018/050401 IL2018050401W WO2018185769A1 WO 2018185769 A1 WO2018185769 A1 WO 2018185769A1 IL 2018050401 W IL2018050401 W IL 2018050401W WO 2018185769 A1 WO2018185769 A1 WO 2018185769A1
Authority
WO
WIPO (PCT)
Prior art keywords
media
collection
user
media item
video
Prior art date
Application number
PCT/IL2018/050401
Other languages
English (en)
Inventor
Aaron ATTAR
Original Assignee
Blink Ap Ltd.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Blink Ap Ltd. filed Critical Blink Ap Ltd.
Publication of WO2018185769A1 publication Critical patent/WO2018185769A1/fr

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/238—Interfacing the downstream path of the transmission network, e.g. adapting the transmission rate of a video stream to network bandwidth; Processing of multiplex streams
    • H04N21/2387—Stream processing in response to a playback request from an end-user, e.g. for trick-play
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/438—Interfacing the downstream path of the transmission network originating from a server, e.g. retrieving encoded video stream packets from an IP network
    • H04N21/4383—Accessing a communication channel
    • H04N21/4384—Accessing a communication channel involving operations to reduce the access time, e.g. fast-tuning for reducing channel switching latency
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/65—Transmission of management data between client and server
    • H04N21/658—Transmission by the client directed to the server
    • H04N21/6587—Control parameters, e.g. trick play commands, viewpoint selection
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/83—Generation or processing of protective or descriptive data associated with content; Content structuring
    • H04N21/845—Structuring of content, e.g. decomposing content into time segments
    • H04N21/8456—Structuring of content, e.g. decomposing content into time segments by decomposing the content in the time domain, e.g. in time segments
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/85—Assembly of content; Generation of multimedia applications
    • H04N21/854—Content authoring
    • H04N21/8549—Creating video summaries, e.g. movie trailer

Definitions

  • the present invention relates to streaming media, and in particular to systems, devices and methods for presenting media contents such as long form media contents.
  • US 2014/0368736 entitled “system and method for selecting media to be preloaded for adjacent channels” discloses a method in which after starting to download the first video stream, the device displays the first video stream and starts to preload one or more video streams including a second video stream. In response to receiving the second request, the device displays at least a portion of the second video stream using a preloaded portion of the second video stream.
  • US 2014/0372888 entitled “System and method for determining whether to use cached media” determines whether a display request meets recency criteria, in which case the device starts to play the second video stream using the cached portion of the second video.
  • US 2013/0132605 entitled “Systems and methods for internet video delivery”, provides a method for delivering video content over the Internet.
  • Video segments are identified and pre-processed by a web service and then separated into a plurality of segments. Based on user interests, video segments may be pre -fetched and stored by a client associated with a user. Upon receiving a selection from a user to play a video, the first video segment may begin playing instantaneously from a local cache.
  • US 2016/0007077 entitled “System and method for allocating bandwidth between media streams” provides a method wherein an electronic device, while displaying a first video stream on the display, allocates, in accordance with a historical pattern of video stream switching of a user, available bandwidth for receiving data at the device at least between receiving the first video stream and preloading a second, non-displayed video stream.
  • US 2015/0365720 entitled “System and method for switching between media streams for non-adjacent channels while providing a seamless user experience”, provides a method of transitioning from displaying a first video stream to displaying a second video stream. A portion of the first video stream is concurrently displayed with at least a portion of the preloaded video content of one or more intervening channels.
  • An object of the invention is to define a simple and inexpensive solution from a resource perspective that provides a good user experience for the cases of flexibility of skipping user requests between media segments.
  • FIG. 1 shows a schematic diagram of a client server system for navigating between media segments supporting smooth transition between segments
  • FIG. 2 shows a flowchart of method of navigation between media segments, in accordance with embodiments.
  • FIG. 3 illustrates a flowchart of method of updating client with its collection of first digital images in accordance with embodiments.
  • first digital image refers to a digital format such as JPEG of first picture or frame of any media segment or item.
  • selection of first digital images refers to a collection of first digital images of certain media items.
  • the client collection of first digital images is cached in device client memory. Each client may handle its own collection of first digital images.
  • the client media player preloads from a server to which it is connected a collection of first digital images. Upon receiving a viewer request to skip to another media segment, the client media player selects and displays the first digital image of the requested media segment from the collection of first digital images. In parallel, the client media player downloads from the server the requested media segment to play. As soon as a portion of the downloaded media segment is ready to play, the media player replaces the display of the first digital image with the downloaded media item. Play of the downloaded media item starts exactly at the timing point, typically corresponding to the display time code, of the first digital image. The transition between display mode to play mode is done exactly at the same point, appearing continuous and uninterrupted to the user.
  • the preloaded collection of first digital images contains a plurality of collections of first digital images at different resolution qualities.
  • the client media player automatically selects the resolution quality of the first digital image for display, according to certain criteria, for example the expected resolution quality of the downloaded media item, such that the transition between the display of the first digital image and the play of media segment will be smooth.
  • the server updates the collection of first digital images in the client media player with new images.
  • the client collection of the first digital images is determined at any time, for example, according the current client viewing position and the client skip requests history.
  • the server updates the collection of first digital images, each displaying a respective initial frame of a plurality of segments, each segment belonging to one or more of a plurality of long form contents.
  • the viewer may skip forward or backward to any segment, or may skip to a media segment from a plurality of related media segments.
  • a related media segment is a media segment, which has semantic similarity based on the likeness of meanings or semantic content, with the currently viewed media segment. For example, a viewer was very impressed with a goal of a famous player and would like to view another goal of the same player.
  • the collection of first digital images is determined based on a client's "skip to segment" request history. For example, if a client usually requests to skip forward or backward, the collection of first digital images will mostly include first digital images of forward or backward segments as appropriate. If the client usually requests for a certain type of related segments, the first digital images collection will include mostly first digital images of the particular type of related segments. To this end, the collection of first digital still images is dynamically updated in real time according to the user's surfing behavior. Likewise, when a user commences a new session, an initial collection of first digital still images may be pre -fetched according to the user's behavior in a previous session and will then be dynamically updated according to actual behavior during the current session. In another embodiment with LIVE programs, the server will constantly update the client collection of first digital images of a new media segment of particular media content, whenever a new media segment of the LIVE program is ready.
  • FIG. 1 shows a schematic diagram of a system 10, such as a client server system, for providing smooth transition while a viewer requests to skip to another media segment.
  • the system 10 includes a media server 11 comprising one or more processors such as CPU (Central Processing Unit) 15 coupled to one or more storage units, such as storage units 21, 22 and memory unit 23.
  • the CPU 15 is configured to operate a first digital image management module 20 that is configured to support client devices with client caching of collection of first digital images.
  • the first digital image management module 20 defines for each client device, a respective optimized collection of first digital images that should be cached in the client device memory.
  • the storage unit 21 stores media content or a URL to content stored for example in another network server.
  • the media content storage unit may contain different resolution types of the same content to support cases of different available network bandwidths as well as different client device type capabilities.
  • one of the storage units, such as memory unit 22 may comprise information relating to media segments of the media contents stored in storage unit 21. Specifically, the stored information includes for example the media segment boundaries, each defining the end of one segment and the start of the next and being defined by timing information, typically at the beginning and end of the segment.
  • the memory unit 22 may contain links from any media segment to a plurality of its related media segments.
  • the memory unit 23 may store a client's 'skip to segment' history requests.
  • the clients 'skip to segment' request history may determine the particular client collection of first digital images.
  • the system 10 further comprises one or more client devices 31 and 41 which may be in communication with the CPU 15 via a network 25, typically the Internet.
  • the devices 31 and 41 may comprise, for example, desktop, laptop, or tablet computers, media consoles, personal digital assistants or smart phones, or any other sort of device with the types of network, media and audio interfaces and computing capabilities needed to interact with the server 11.
  • device 31 may be a computer with a processor 32, memory 33, display 34, a user interface configured to receive a navigation command from a user, a communication module configured to communicate with the server 11 and other units such as speakers.
  • Device 41 may be similarly equipped, though in different configurations.
  • device 41 may be a mobile phone comprising a processor 42, display 44 and memory 43.
  • the memories 33 and 43 may each store a collection of first digital images.
  • the processors 32 and 42 may select for display the appropriate first digital image from the stored collection of first digital images, until the corresponding media segment is ready to play.
  • the processors 32 and 42 comprise a media player software module which is configured to download media content, for example from the server network 25.
  • the devices 31 and 41 are further provided with respective user interfaces 37 and 47 which are configured to receive and recognize the viewer's navigation commands.
  • the user interfaces 47 and 37 may include a touchscreen or gesture recognition sensor configured to identify one or more skip navigation commands for example skip to the next content segment or skip to a related segment.
  • the navigation commands may include for example one or more swipes across the touchscreen.
  • the navigation commands may be one or more gestures or postures. The gestures can originate from any bodily motion such as the face or hand.
  • the swipe or gesture commands may be transmitted via the network 25 to the server 11, and accordingly the server 11 returns the next media segment to be played or a URL for the next segment.
  • a different server storing the required media content may convey the media content to the client under the direction of the server 11.
  • Fig. 2 shows a flowchart 200 of a method of navigation between media segments, in accordance with some embodiments.
  • a user viewing a media segment requests to skip to another media segment.
  • the request to skip media segment can be for example a request to skip forward.
  • the user may request to skip to any of related segment from a plurality of related segments.
  • the user issues a skip request while for example client device processor 32 has not finished handling previous client skipping requests, such that while issuing the last skipping request, the device processor 32 is busy with preparing a previous next media segment to play.
  • the processor 32 checks whether the requested media segment is cached in memory and ready to play.
  • the client device sets the media background layout for media display and plays the media segment. If the requested media segment is not ready, the client device will display the first digital image of the requested media segment.
  • the processor 32 determines the expected video resolution of the requested media segment. The expected video resolution is determined for example by the current available network bandwidth, the video display resolution of previous media segments or the resolution of the current download of the requested media segment, in case segment download has already been started. On operation 211, based on the expected video display resolution, the processor 32 selects the appropriate first digital image of the requested media segment. On operation 213, the processor 32 sets the graphic display background layout and displays the selected first digital image.
  • the processor 32 downloads the requested media segment from the server.
  • the server CPU 15 updates the client 'skip to segment' requests information, on the client's 'skip to segment' history memory 23.
  • the server CPU 15 updates the 'video display resolution' information of the last media segment, on the client's 'video display resolution' history memory 17.
  • the processor 32 checks whether downloaded media segment is ready to play. As soon as the media segment is ready to play, the processor 32 replaces the setting of the graphic display background layout definition for the first image display, with the video foreground layout to display the played media segment.
  • Fig. 3 shows a flowchart of method 300 of updating a client with its collection of first digital images, in accordance with some embodiments.
  • the client requests the server to build a list of first images for its collection of first digital images.
  • the client may request from the server an update for its collection, in case the current played media segment is changed.
  • the client may request from the server an update for its collection, in case the user makes multiple skip requests in a time period that is shorter than a specified threshold. This may happen when a user is searching for a specific item and swipes forward or backward in quick succession until the desired item appears.
  • the client may request from the server an update for its collection, in case the available network bandwidth changes by more than a specified threshold.
  • the server CPU 15 builds a profile of the client skip requests according to its client skip requests history.
  • the profile of the client skip requests can for example indicate the probability that client skip request will be to skip forward, skip backward or skip to a related segment. In another case, when a client requests to skip to a related segment, based on the client skip requests history, the profile indicates the probability to which type of related segment the user will request to skip.
  • the first digital image management module 20 based on the currently played media segment in the client device and the profile of the client skip requests, the first digital image management module 20 generates the list of first digital images for the client collection of first digital images. In one embodiment the list of first digital images is determined by the available client resources, for example available storage space of the client device.
  • the client device downloads the list of first digital images from the server.
  • the processor 32 checks for whether it is cached in the collection of the first digital images.
  • the client requests from the server to download the first digital image for caching.
  • the CPU 15 reads the first digital image of the particular media segment from the media content storage 21 and converts the digital video format such as MP4 to a still picture digital image type of format such as JPEG.
  • the client downloads from server JPEG of first digital image for caching.
  • the system according to the invention may be a suitably programmed computer.
  • the invention is most typically executed using a smartphone, it can be executed using any computer having suitable user and telecommunications interfaces. Therefore, the term "computer” as used in the claims is to be understood in this context and is not limited to a dedicated computer.
  • the invention contemplates a computer program being readable by a computer as just defined for executing the method of the invention.
  • the invention further contemplates a machine-readable memory tangibly embodying a program of instructions executable by the machine for executing the method of the invention.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Databases & Information Systems (AREA)
  • Computer Security & Cryptography (AREA)
  • Information Transfer Between Computers (AREA)

Abstract

Dans un procédé de transition entre des segments vidéo lors de la transmission en continu de vidéo à la demande, un premier élément multimédia dans une séquence vidéo est affiché sur un lecteur multimédia et un ensemble de fichiers d'images fixes est téléchargé, chacun affichant une trame initiale d'un élément respectif parmi une pluralité d'éléments multimédias attendus dans la séquence vidéo. Lors de la réception d'une commande d'utilisateur permettant de naviguer vers un second élément multimédia dans la séquence vidéo, le procédé vérifie si le second élément multimédia est l'un des éléments multimédias attendus ; et si tel est le cas, il restitue l'image fixe respective du second élément multimédia en vue d'un affichage par le lecteur multimédia en cours d'attente d'affichage du second élément multimédia.
PCT/IL2018/050401 2017-04-03 2018-04-04 Lecture à démarrage sans à-coups d'éléments multimédia WO2018185769A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US201762480548P 2017-04-03 2017-04-03
US62/480,548 2017-04-03

Publications (1)

Publication Number Publication Date
WO2018185769A1 true WO2018185769A1 (fr) 2018-10-11

Family

ID=62116923

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/IL2018/050401 WO2018185769A1 (fr) 2017-04-03 2018-04-04 Lecture à démarrage sans à-coups d'éléments multimédia

Country Status (1)

Country Link
WO (1) WO2018185769A1 (fr)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114946192A (zh) * 2020-01-15 2022-08-26 杜比国际公司 利用比特率切换自适应流式传输媒体内容

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090158326A1 (en) * 2007-12-18 2009-06-18 Hunt Neil D Trick Play of Streaming Media
US20130132605A1 (en) 2011-11-23 2013-05-23 Aol Inc. Systems and Methods for Internet Video Delivery
US20140368736A1 (en) 2013-06-17 2014-12-18 Sporify AB System and method for selecting media to be preloaded for adjacent channels
US20150067744A1 (en) * 2013-08-27 2015-03-05 Home Box Office, Inc. Providing responsive video previews during rewind and fast forward
US9021526B1 (en) * 2013-05-03 2015-04-28 Amazon Technologies, Inc. Video navigation preview

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090158326A1 (en) * 2007-12-18 2009-06-18 Hunt Neil D Trick Play of Streaming Media
US20130132605A1 (en) 2011-11-23 2013-05-23 Aol Inc. Systems and Methods for Internet Video Delivery
US9021526B1 (en) * 2013-05-03 2015-04-28 Amazon Technologies, Inc. Video navigation preview
US20140368736A1 (en) 2013-06-17 2014-12-18 Sporify AB System and method for selecting media to be preloaded for adjacent channels
US20140372888A1 (en) 2013-06-17 2014-12-18 Spotify Ab System and method for determining whether to use cached media
US20150365720A1 (en) 2013-06-17 2015-12-17 Spotify Ab System and method for switching between media streams for non-adjacent channels while providing a seamless user experience
US20160007077A1 (en) 2013-06-17 2016-01-07 Spotify Ab System and method for allocating bandwidth between media streams
US20150067744A1 (en) * 2013-08-27 2015-03-05 Home Box Office, Inc. Providing responsive video previews during rewind and fast forward

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114946192A (zh) * 2020-01-15 2022-08-26 杜比国际公司 利用比特率切换自适应流式传输媒体内容
US11997339B2 (en) 2020-01-15 2024-05-28 Dolby International Ab Adaptive streaming of media content with bitrate switching

Similar Documents

Publication Publication Date Title
US12254167B2 (en) Intelligent content queuing from a secondary device
KR102152211B1 (ko) 복수의 미디어 아이템 시퀀스들에서 미디어 아이템들 간에 전환을 위한 시스템 및 방법
US9596518B2 (en) System and method for searching an internet networking client on a video device
US20210103363A1 (en) Method and an electronic device for performing playback of streamed media including related media content
JP7129517B2 (ja) ３６０ビデオストリーミングのための予測ビットレート選択
US20230045363A1 (en) Video playback method and apparatus, computer device, and storage medium
US9319455B2 (en) Method and system for seamless navigation of content across different devices
US10938871B2 (en) Skipping content of lesser interest when streaming media
US20200099987A1 (en) Systems and methods for displaying a live video stream in a graphical user interface
CN112486364A (zh) 用于包括交互式网格显示的媒体应用的系统和方法
WO2018185769A1 (fr) Lecture à démarrage sans à-coups d'éléments multimédia
EP4518326A1 (fr) Procédés et systèmes de commande de rapports d'aspect de contenu de diffusion en continu
US20250142153A1 (en) Systems and methods for dynamically modifying components of a playback control graphical user interface on a second screen device
US11032586B2 (en) Techniques for dynamic digital advertising
HK1225205A1 (en) System and method for switching between media items in a plurality of sequences of media items

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 18723073

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 18.03.2020)

122 Ep: pct application non-entry in european phase

Ref document number: 18723073

Country of ref document: EP

Kind code of ref document: A1