CN101477575A - Multimedia information storing and playing method and apparatus - Google Patents
Multimedia information storing and playing method and apparatus Download PDFInfo
- Publication number
- CN101477575A CN101477575A CNA2009101051870A CN200910105187A CN101477575A CN 101477575 A CN101477575 A CN 101477575A CN A2009101051870 A CNA2009101051870 A CN A2009101051870A CN 200910105187 A CN200910105187 A CN 200910105187A CN 101477575 A CN101477575 A CN 101477575A
- Authority
- CN
- China
- Prior art keywords
- paging
- access unit
- information
- multimedia
- sub
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 34
- 238000003860 storage Methods 0.000 claims description 73
- 238000006243 chemical reaction Methods 0.000 claims description 3
- 238000009331 sowing Methods 0.000 claims description 2
- 230000006978 adaptation Effects 0.000 abstract 1
- 238000010586 diagram Methods 0.000 description 5
- 238000005516 engineering process Methods 0.000 description 4
- 238000010276 construction Methods 0.000 description 2
- 101150039623 Clip1 gene Proteins 0.000 description 1
- 101150103904 Clip2 gene Proteins 0.000 description 1
- 241001269238 Data Species 0.000 description 1
- 241000132179 Eurotium medium Species 0.000 description 1
- 102000006479 Heterogeneous-Nuclear Ribonucleoproteins Human genes 0.000 description 1
- 108010019372 Heterogeneous-Nuclear Ribonucleoproteins Proteins 0.000 description 1
- 238000005520 cutting process Methods 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 230000018109 developmental process Effects 0.000 description 1
- 239000012467 final product Substances 0.000 description 1
- 238000005243 fluidization Methods 0.000 description 1
- 239000012634 fragment Substances 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 230000004807 localization Effects 0.000 description 1
- AWSBQWZZLBPUQH-UHFFFAOYSA-N mdat Chemical compound C1=C2CC(N)CCC2=CC2=C1OCO2 AWSBQWZZLBPUQH-UHFFFAOYSA-N 0.000 description 1
- 230000005012 migration Effects 0.000 description 1
- 238000013508 migration Methods 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 238000005457 optimization Methods 0.000 description 1
- 230000011218 segmentation Effects 0.000 description 1
- 230000002123 temporal effect Effects 0.000 description 1
Images
Landscapes
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention relates to the technical field of multimedia, in particular to a method and a device for storing and broadcasting multimedia information. The invention provides a method for storing the multimedia information, which comprises the following steps: A, multimedia documents including at least one independent paging are established or opened by preset document names, the multimedia documents include format description information of the multimedia documents, and the format description information includes conversational description agreement information and paging information; and B, the data of multimedia information to be stored is stored in each paging of the multimedia documents according to the format description information, and each paging of the multimedia documents is divided into more than one independent access unit and used for loading and storing a data packet of the paging of the multimedia documents. The invention can not only realize the real-time zero access of the multimedia information within several seconds, but also solve the problem that the access efficiency is low due to small data access and massive adaptation; and meanwhile, the data is convenient for division and mergence and compatible standard format.
Description
Technical field
The present invention relates to multimedia technology field, particularly a kind of multimedia information storage and player method and device thereof.
Background technology
At present, adopt in the process that the stream mode plays, generally all need to carry out the storage of image, so that playback in the future for realtime graphic.But according to the way of present most of this areas, all be to adopt picture pick-up device, live video be converted to file layout confession broadcasts in the future such as MP4.But for the time-shift service demand that increases day by day at present, the mode of this storage unloading be because complete MP4 file build needs cause storage speed slow excessively for a long time, has been not suitable for the play-on-demand program demand after several seconds fully.
In the prior art segmentation has been proposed also or burst is stored the method that improves positioning playing position efficient.But burst storage also exists the small data read-write more, is difficult to avoid the data to writing index unit to be rewritten simultaneously, causes performance, efficient relatively poor, and is converted into the shortcoming of trouble of normative document.Small data typically refers to metadata, such as some descriptors, or one or two discrete packet.Because file system is a unit with Block structures such as (pieces) normally, if the visit small data, the resource of actual consumption and travel all over Block is suitable, and Li San small data is difficult to hit buffer memory in addition, so the small data read-write too much can influence performance.
As seen also do not have at present a kind of storage format both to satisfy the demand of the real time high-speed access in the multimedia data information several seconds, solve the small data access issues as above mentioned again simultaneously, be convenient to cut apart and merge and the problem of compatibility standard form.
Summary of the invention
Technical matters to be solved by this invention provides a kind of real time multimedia image information storage means, overcome in the prior art for form complexity, handle in the multimedia file storage of adopting the stream mode to play too much, small data access and rewrite the low problem of access efficiency that too much causes, and can reach to be convenient to cut apart and merge and the purpose of compatibility standard form.
In order to solve the problems of the technologies described above, the invention provides a kind of multimedia information storage method, may further comprise the steps:
A, set up or open the multimedia file that comprises at least one independent paging according to default filename, described multimedia file comprises the format description information of described multimedia file, and described format description information comprises information of session description protocol and divides page information;
B, deposit multimedia information data to be stored each paging of described multimedia file in, and be divided into more than one each paging of described multimedia file independently that access unit is used to load the packet that deposits described multimedia file paging in according to described format description information.
Further, the nested again sub-access unit of n level that is subdivided into of described access unit, n is the integer more than or equal to 0.
Further, described step B comprises:
B1, the sub-access unit of each n level are respectively the information packet that deposits in wherein and set up the sub-access unit index information of n level.
Further, described step B also comprises:
B2, each sub-access unit are set up the index information of sub-access unit at the corresponding levels respectively according to the index information of the sub-access unit of its subordinate;
B3, each access unit are set up the access unit index information according to the index information of its subordinate's the 1st grade of sub-access unit respectively.
Further, also comprise after the described step B3:
B4, each paging merge generation paging index information with the access unit index information in the described multimedia file paging.
Further, also comprise step after the step B:
C, described paging index information merged the general index information that generates described multimedia file.
Wherein, described paging information comprises:
The paging foundation, be meant the criterion of the division institute foundation of page or leaf, described criterion can be the time according to the multimedia file of storage, perhaps according to the shared space of multimedia file of storage or according to the bag quantity of the multimedia file of storage, perhaps according to the identifier of the multimedia file of storage or according to alternative document that is linked to and address location, perhaps according to the combination of above any criterion;
Paging tolerance, corresponding with the paging foundation, be used to measure the paging foundation, if the paging criterion is the shared space of multimedia file according to storage, then paging tolerance is the unit of every page space size; If the paging criterion is the time according to the multimedia file of storage, then paging tolerance is the unit of every page time span; If the paging criterion is the identifier according to the multimedia file of storage, then paging tolerance is every page identifier; If the paging criterion is alternative document and address location according to link, then paging tolerance expression is linked at information such as position in the file or appointed file name.
Wherein, the whole file of described multimedia file or paging or access unit or sub-access unit adopt standard media form or self-defining media formats, and each paging and access unit and sub-access unit adopt identical or different media formats each other.
The invention provides a kind of multimedia messages player method, may further comprise the steps:
D, when multimedia file by a sowing time, server reads the corresponding information of session description protocol of described multimedia file and offers client;
E, when the link establishment between client and server successfully begins to play, be positioned to minute page position at the corresponding packet place of fixed time point by general index information or by traveling through each paging index information;
F, navigate to after packet reads the position, begin, carry out the packet operation according to the condition of client setting from this packet.
Further, step e also comprises:
E1, according to described fixed time point, in current paging, search the corresponding access unit position, packet place of described fixed time point according to described paging index information or by traversal access unit index information;
E2, according to the fixed time point, in current access unit, search the corresponding sub-access unit position, packet place of described fixed time point according to described access unit index information or by traveling through sub-access unit index information;
E3, up to the sub-access unit of the n level position that is positioned to the corresponding packet place of described fixed time point.
Further, in the step e: if when the corresponding packet of described fixed time point is in last still incomplete paging, after then being positioned to the access unit or sub-access unit in the described imperfect paging, in current access unit or sub-access unit, searching packet and read the position; If search less than the corresponding packet of described fixed time point, then in access unit or sub-access unit, search packet and read the position forward or backward or by searching algorithm at current access unit or sub-access unit.
The invention provides a kind of multimedia information storage device, comprising:
File is set up module, is used for setting up or opening a multimedia file according to default filename, and described multimedia file comprises the format description information of described multimedia file, and described format description information comprises information of session description protocol and divides page information;
Divide module, set up module with file and be connected, be used for described multimedia file being divided at least one independent paging, and each paging is divided at least one independently access unit according to described format description information;
The information conversion module is connected with the division module, is used for multimedia information data to be stored is deposited in the access unit of ready-portioned each paging of described multimedia file.
Also comprise in the described division unit:
Sub-access unit is divided module, is used for according to described format description information nested at least one the independently sub-access unit of n level that is divided into of each described access unit, and n is the integer more than or equal to 0.
Also comprise in the described device:
The index generation module is used for finishing at sub-access unit or access unit or paging structure the index information of the sub-access unit of after-cost or access unit or paging.
The invention provides a kind of multimedia messages playing device, comprising:
The command reception module is used to receive the condition that client is provided with, and comprises concrete operations action and fixed time point to multimedia file in the described condition;
Locating module is used for being positioned to paging or the access unit or the sub-access unit of the n level position at the corresponding packet place of fixed time point according to the condition of described client setting by the index information of multimedia file, and n is the integer more than or equal to 0;
Operational module is connected with locating module, after being used to navigate to packet and reading the position, begins from this packet, carries out the packet operation according to the condition of client setting.
Multimedia information storage provided by the invention and player method and device thereof, be applicable to the TV industry, the monitoring trade that need to carry out playback under the multimedia field of storage, for adopting RTSP (Real Time StreamingProtocol, real-time streaming protocol) mode is carried out live various occasions, has more practical significance for the playback of packet.Compared with prior art, not only can realize the real time high-speed access in the multimedia messages several seconds, solve the small data access again and rewritten the low problem of access efficiency that too much causes, also make data be convenient to cut apart simultaneously and merge and the compatibility standard form.
Description of drawings
Fig. 1 is the one-piece construction synoptic diagram of RSF storage format provided by the invention;
Fig. 2 is the structural drawing of a kind of RSF file memory format of providing of the embodiment of the invention one;
Fig. 3 is the structural drawing of each paging in a kind of RSF file memory format of providing of the embodiment of the invention one;
Fig. 4 is the structural drawing of single access unit (Clip) in a kind of RSF file memory format that the embodiment of the invention one provides.
Fig. 5 is the structural drawing of a kind of RSF file memory format of providing of the embodiment of the invention two;
Fig. 6 is the structural drawing of a kind of RSF file memory format of providing of the embodiment of the invention three;
Fig. 7 is the process flow diagram of a kind of RSF file memory method of providing of the embodiment of the invention four;
Fig. 8 is the process flow diagram of a kind of RSF document play-back method of providing of the embodiment of the invention five.
Embodiment
Below in conjunction with the drawings and specific embodiments the present invention is described in further detail.
Core concept of the present invention is with the file paging, and each paging all is an independently media structure (this media structure can be standard format such as MP4/TS/AMR/AAC, also can be self-defined privately owned form).Wherein paging can nestedly comprise some access units and sub-access unit (access unit and sub-access unit are media structure independently equally, can be called Clip), thus the real-time that improves storage and read.Described media structure be meant one independently, cut out the unit that just can play, such as a little MP4 file, one section TS file, or the user-defined format file fragment of an energy fluidizing program request.Wherein each paging and access unit (comprising sub-access unit) can adopt unified media formats, also can adopt the media formats that differs from one another.
The present invention is by a kind of user-defined format file of structure, and Real Stream File (english abbreviation: RSF, real-time streaming files) is to realize the quick access and the positioning playing of real-time multimedia information.The storage format of RSF file provided by the invention is made up of a plurality of pagings as shown in Figure 1, each independent paging all is an independence, complete media structure, extract functions such as program request/skip forward/back still can be provided separately, and be convenient to cutting, merge and extract.
Comprise following information in the described RSF file:
1, the information of session description protocol of multimedia file (hereinafter to be referred as SDP information), described SDP information comprises the orbit information of multimedia file, sample information, playback rate, when sending program request according to the multimedia file of user-defined format storage of the present invention, user end to server returns the SDP information of this multimedia file to the program request client, (be the optional mode in the RTSP agreement perhaps by the Announce mode, if client is issued server, expression is described the media object of request and is issued server, represent real-time update link descriptor if server is issued client) or the Describe mode (be the way of recommendation in the RTSP agreement, the common customer end is sent out Describe and is asked to server, and server is with descriptor, authentication informations etc. return client) obtain;
Information such as time keeping when 2, creating this RSF file, time keeping not necessarily, but if not free record then this RSF file when playing, may correspond to the real time;
3, paging information comprises paging foundation and paging tolerance, paging is according to the criterion that is meant the division institute foundation of paging, this criterion can be according to the time of the multimedia file of storage or according to the shared space of multimedia file of storage or according to the bag quantity of the multimedia file of storage or according to the identifier of the multimedia file of storage etc., even can be according to alternative document that is linked to and address location, simultaneously can also be according to any combination of above-mentioned criterion, for example some page or leaf is by the space, and some page or leaf was divided by the time in addition; Paging tolerance is corresponding with the paging foundation, is used to measure the paging foundation, and for example, if the paging criterion is the shared space of multimedia file according to storage, then paging tolerance is the unit of every page representation space sizes such as byte number; If the paging criterion is the time according to the multimedia file of storage, then the unit that represents express time sizes such as millisecond number is measured in paging; If the paging criterion is the identifier according to the multimedia file of storage, then paging tolerance is every page identifier; If the paging criterion is alternative document and address location according to link, then paging tolerance expression is linked at information such as position in the file or appointed file name; The whole file of described multimedia file or paging or access unit or sub-access unit adopt standard media form for example MP4/TS/AMR/AAC or self-defining media formats, and each paging and access unit and sub-access unit adopt identical or different media formats each other;
4, other optional informations (as version information, compatible format information and code stream information etc.).
As above these information are designated hereinafter simply as the format description information of RSF, as shown in Figure 1, can be used as the medium head and leave in the homepage of RSF file, become the format description paging of whole RSF file; Whole media information is divided into n medium paging, i.e. medium paging one is to medium paging N; The general index paging that media index part merges generation for the index according to each paging is additional to the end of whole file, and general index paging last paging for adding has been constructed complete in case add the whole RSF file of expression.
Be illustrated in figure 2 as the form example of a kind of RSF file that the embodiment of the invention one provides, wherein all compatible iso standard MP4 of all pagings and access unit form.In the paging of the RSF of RSF homepage format description information, comprise file type descriptor (with the ftype box among the ISO) and format description atom (self-defined expansion box) medium head as this RSF file.Comprise information such as the SDP information of media file of this request storage and paging foundation in the format description atom.Described paging can be according to multiple criterion, as the time according to the media data of storing, the size of the media data of storage etc. according to the division that is meant page or leaf.For example the size according to media data is the space paging, and for the optimization that cooperates file system is read, the regular length of desirable 4M byte is the size of a paging, and the 4M byte is a paging tolerance.CDdata is the media data district of access unit among the figure; Coov is the index area of access unit; Poov is the paging index area; 2s represents 2 seconds; Size represents size; Free represents the free time.
Wherein the concrete form of each paging as shown in Figure 3.Each paging all is that (box is the notion in ISO and the MP4 Standard File Format to a box among the ISO when complete, all MP4 inner structures all are made up of box, each box comprises the box size, box type and other information), the box content is a complete MP4 file, comprise mdat (the media data district of MP4 file also is a box) and the index moov atom of oneself (being the general index district of MP4 file, also is a box).And each paging by one by one independently access unit (Clip) form, storage unit can also nestedly again be subdivided into littler sub-access unit (being also referred to as Clip).In the paging as shown in Figure 3, Clip1 comprises following components: Size=4M represents that the size of this paging is 4M, and unit is a byte; Type=" page " represents that the type of this media structure is paging; AbsTime represents the lead time of each Page (paging) with respect to whole RSF file; Then be that access unit Clip2 is to ClipN; Free represents the free time; Poov represents the paging index area; PoovSize represents the size of paging index information; Bytes represents the shared byte number of each access unit.As seen the MP4 form of the compatible iso standard of this paging.
Similarly, the concrete structure of Clip as shown in Figure 4, in fact Clip also is the box of an ISO, the box content remains a complete little MP4 file.Wherein, Size represents the size of this Clip, and type is an access unit, and Timeoffset is time migration, represents the lead time of this Clip with respect to Page or higher level Clip; Coov represents the access unit index area.As seen the also MP4 form of compatible iso standard of this Clip.
Further, an access unit can also be made up of how little sub-access unit, and minimum sub-access unit must be complete media structure, otherwise just can't be read identification, and therefore the sub-access unit of minimum must comprise the index of oneself.According to embodiments of the invention with the nested sub-access unit of n level that is subdivided into of access unit, n is the progression of sub-access unit, then the sub-access unit of n level is the sub-access unit of subordinate of the sub-access unit of n-1 level, n is the integer more than or equal to 0, represents no longer to segment under the access unit access unit when n equals 0; When equaling 1, n represents only to be divided under the access unit 1 grade of sub-access unit, so the 1st grade of sub-access unit of subordinate that sub-access unit is an access unit; When equaling 2, n represents nestedly under the access unit to be divided into 2 grades of sub-access units the 2nd grade of sub-access unit of subordinate that sub-access unit is the 1st a grade of sub-access unit so, the 1st grade of sub-access unit of subordinate that sub-access unit is an access unit; When n greater than 2 the time by that analogy.Each sub-access unit or access unit can be respectively the information packet that deposits in wherein and set up sub-access unit index information or access unit index information, and the sub-access unit of n level must comprise the index information of oneself.For example we to set a paging be the 100M byte, one-level Clip locatees 4M then, secondary Clip location 2 seconds, then 2 seconds data just begin to write (secondary Clip will with the index of oneself) after constituting a secondary Clip, when reaching 4M, just generate the index of one-level Clip, when all secondary Clip size just writes the paging index during to 100M, setting is convenient to accelerate locating speed like this.
Be illustrated in figure 5 as the form example of a kind of RSF file that the embodiment of the invention two provides.Wherein the medium head is the paging of format description information, each paging all is that the TS file of a standard wraps index in conjunction with self-defining TS, from TS form paging one and TS form index one to TS form paging N and TS form index N, when finishing, storage can add a total TS bag index overall file TS index in the end.Same, each paging also can be adopted (the Advanced Audio Coding as AAC, the Advanced Audio Coding technology), these standard media forms or other self-defining media formatss such as MP3, ARM, and last additional standard or the self-defining index that can generate at file equally.
Be illustrated in figure 6 as another form example of a kind of RSF file that the embodiment of the invention three provides.Wherein the medium head is format description information paging (band MP4 format description box), next is paging one, comprises paging one of MP4 form and paging one MP4 form index, and its paging is according to being according to the time, and tolerance is 3 minutes; Paging two comprises self-defined privately owned form paging two and paging two user-defined format index, and its paging is according to being by the space, and tolerance is the 5M byte; Be each paging and index thereof then; Paging p comprises the TS form index of TS form paging p and paging p, and its paging is according to being that tolerance is 32768 according to bag quantity; Also comprise access unit among the paging q: the index of the Clip one of the Clip one of paging q (self-defined medium access structure) and paging q; The MP4 form index of the Clip two of the Clip two of paging q (standard MP4 access structure) and paging q; The Clip of paging q divides by the type of packet, and when the first packet that satisfies Clip is the key frame first packet, the tail bag is the postamble bag; The time in Clip when storage surpasses 4 seconds or the space greater than the 128K byte, then Clip finishes; Treat the paging index (user-defined format) that need increase when last paging is complete; Treat that the user need stop storage, increasable file global index general index (the Moov atomic format of MP4 form during filing, make whole file compatibility standard MP4 form), after having added this Moov, because format description box and dat have been reserved in the front, whole file becomes the file of a compatibility standard MP4 form.After finishing, can be play this document structure by Streaming Media instrument or universal player.
Fig. 7 is the process flow diagram of a kind of RSF file memory method of providing of the embodiment of the invention four, (as RTSP, mode RTP) is carried out in the playing programs process, in case start the order that begins to store when adopting fluidisation, then store, may further comprise the steps according to the foregoing description RSF file layout:
S110, according to default filename, the filename of user's appointment for example, set up or open a RSF file that comprises several independent pagings, and in the homepage of this document the format description information of this RSF file of storage, described format description information comprises information such as SDP information and form, time, version;
Wherein, " foundation " does not have this document before being meant, sets up a new RSF file according to the filename of user's appointment, has had a RSF file with the filename name of user's appointment to exist before " opening " is meant, and be correct, then can open it and then continue storage;
Described format information is the branch page information, the foundation (press duration, press the space size, press media information bag quantity etc.) that specifically comprises each paging, the form of each paging (MP4,3GP, TS, AAC, self-defined etc.), whether each paging inside divides littler access units such as Clip, the quantity of Clip etc. again;
Wherein, comprise in the described SDP information multimedia file orbit information, sample information, when the user asks to play the file of storage, return the descriptor of this document etc., the SDP information of this document can be to be sent to the program request client by server when this media program of request program request, also can obtain by Announce mode or Describe mode.Because this SDP information in media program manufacturing process, remains unchanged, storage is a when therefore only needing to start gets final product;
Described temporal information comprises time point of creating this RSF file etc.; Described version information is meant information such as this version number of this RSF file;
In a preferred embodiment, if the paging foundation is according to the space size, the then new RSF file of creating is not before also beginning to store the information data of any media file, generally should account for the size of or an integer paging, an if not integer paging size just in time, for example homepage is the paging of format description information, the not necessarily integer paging of its shared space, then can reach the space of an integer page or leaf by padding data (media file data or insignificant data), make each page size fix, thereby find the position of paging index further to improve the efficient of searching and locating easily when file is read;
S120, according to above-mentioned RSF format description information, the multimedia information data bag received (such as the RTP bag) is carried out successively or constitutes each paging by the particular order storage, and each paging area is divided into several access units Clip (can be self-defined or standard compliant media formats equally) according to described format description information, wherein each Clip or paging all have the index of oneself.These index comprise that data packet number, type of data packet and the minimax time among position, paging or the Clip that packet reads (refers to storage or receiving media bag time, be used to define duration and the border of file, paging, Clip, be convenient to play regularly and the location) etc. information.Described storage successively promptly is meant from paging stores to a last paging at the beginning; Be meant according to technological development personnel named order by particular order and store, for example write paging one, three, five earlier, after write paging two, four, six.When the information packet of media file enters paging, data pack buffer is made up access unit, store one or an integer access unit at every turn.When several access units deposit in, when satisfying the condition of a complete paging, form complete paging index according to these access units index separately and invest the paging end.Can reduce the number of times of data storage like this, reduce the small data quantity storage, realize appending and write, avoid to rewrite.Each paging and the access unit of described RSF file also can adopt MP4,3GP, TS, AAC, user-defined format etc., and can also adopt different forms each other.
The actual information of described correspondence is on the position that the document misregistration amount is pointed to, this position can be in the file at RSF file place, also can with file that it is associated in, the actual content of the media structure that expression is read, above-mentioned " information such as the media units quantity among position, paging or the Clip, media units type and minimax time that actual information refers to." therefore, paging is according to being not limited only to by space or time, also may be behind position, to point to the link of another file in the file, promptly these information also may be on other different files, and most cases is by the locus paging certainly.
When media file storage finishes, the index information of all pagings can also be merged general index information of generation and invest the RSF end of file, make whole RSF file become a big complete absolute construction that is suitable for fast access.Same, this structure can adopt our self-defined privately owned form, also can adopt the file layout of conformance with standard (as MP4, TS etc.).
The last general index of RSF file comprises the index information of all media datas in the whole file of RSF; The index of each paging comprises the index information of this paging media data separately in the RSF file; The index of each Clip (access unit) comprises the index information of this Clip media data separately; Wherein, minimum Clip must comprise the index information of oneself, and media data is meant the information packet that deposits in the media structure.
Each paging need keep first media data of this paging usually and goes up information such as the time offset of last media data of paging and locus side-play amount relatively in the described RSF file.
Storage means by multimedia file provided by the invention is the unit of writing of minimum with an access unit or sub-access unit.Before Clip is complete, all be complete in buffer memory in all processes that wraps in structure Clip, after Clip is complete, write disk, just can not revise again.Historical facts or anecdotes has showed the frequent read-write of avoiding small data, avoids write-back and covering to write, and only allows to append to write (promptly can only allow writing after the writing position).If requirement can be read in real time, then need each access unit buffer memory can not be too many, keep just being updated into disk in several seconds.
Fig. 8 is the process flow diagram of a kind of RSF document play-back method of providing of the embodiment of the invention five, for according to the RSF media file of the inventive method storage when playing, comprise following step:
S210, when client was sent Describe request program request with the media program of RSF form storage according to the time point of user's appointment, server read the SDP information of storing in the paging of RSF format description information and offers client;
S220, when the link establishment between client and server successfully begins to play, if this RSF file has added the paging of file general index information, then the RSF file has been the media structure of an independent completion, can be positioned to the packet of user's fixed time point by the RSF index information in the general index paging at RSF end, so that carry out follow-up reading and playing; If the not additional as yet general index information paging of this RSF file is then searched with searching algorithm by paging index information separately, be positioned to the paging of appointment;
S230, be positioned to concrete paging after, same, if this paging added paging index (promptly being a complete media structure), then can be positioned to the corresponding packet of user's fixed time point to read and to play by the paging index information; If this medium paging does not have paging index (normally because this paging is last medium paging, storage is incomplete as yet) as yet, then search with searching algorithm by the index information separately of each access unit (Clip), be positioned to concrete access unit; If concrete page format information is that access unit is no longer segmented in paging, then step 230 can be economized; If segment sub-access unit in addition under the access unit, then be positioned to minimum Clip according to the localization method of step S230 till; For example, also segment under the one-level access unit the storage unit of secondary is arranged, if this one-level access unit does not have to add the index of oneself (normally because this access unit is last access unit in last medium paging, storage is incomplete as yet) then search with searching algorithm by the index information separately of the sub-access unit of each secondary, be positioned to the sub-access unit of concrete secondary;
S240, information packet (RTP bag, TS bag etc.) information according to the media file that writes down in user's fixed time point and paging index or access unit index or the sub-access unit index navigates to the corresponding particular location of packet in described paging or access unit or sub-access unit of user's fixed time point, promptly finds the media data of user institute program request;
Because the broadcast of medium needs sometimes from key frame, therefore by the index information in the medium paging (or access unit Clip), the location is apart from the packet at the nearest key frame place of this fixed time point; If in this paging (or Clip), do not have packet, then search forward or in the medium paging backward (or access unit Clip) with this characteristic;
S250 begins from this packet, carries out the operation of packet according to the condition that the user is provided with, as reads bag, writes bag, gets package informatin, searches sequence number, looks into the time, looks for bag etc. by the time by sequence number by the time.
Embodiments of the invention also provide a kind of multimedia information storage device simultaneously, comprise: file is set up module, be used for setting up or open a multimedia file according to default filename, described multimedia file comprises the format description information of described multimedia file, and described format description information comprises information of session description protocol and divides page information; Divide module, set up module with file and be connected, be used for described multimedia file being divided at least one independent paging, and each paging is divided at least one independently access unit according to described format description information; The information conversion module is connected with the division module, is used for multimedia information data to be stored is deposited in the access unit of ready-portioned each paging of described multimedia file.Also comprise in the described division unit: sub-access unit is divided module, is used for according to described format description information nested at least one the independently sub-access unit of n level that is divided into of each described access unit, and n is the integer more than or equal to 0.Also comprise in the described device: the index generation module is used for finishing at sub-access unit or access unit or paging structure the index information of the sub-access unit of after-cost or access unit or paging.
Embodiments of the invention also provide a kind of multimedia messages playing device, comprising: the command reception module, be used to receive the condition that client is provided with, and comprise concrete operations action and fixed time point in the described condition to multimedia file; Locating module is used for being positioned to paging or the access unit or the sub-access unit of the n level position at the corresponding packet place of fixed time point according to the condition of described client setting by the index information of multimedia file, and n is the integer more than or equal to 0; Operational module is connected with locating module, after being used to navigate to packet and reading the position, begins from this packet, carries out the packet operation according to the condition of client setting.
Except time-shift service, the speed that the present invention also can improve storage and play for non-time-shift service.In addition, the present invention is mainly used in Streaming Media, but is not limited thereto, and for other real time multimedia image informations, for example Flash also is suitable for, and its storage and back method are similar to the above embodiments, so do not give unnecessary details at this.
Claims (15)
1, a kind of multimedia information storage method is characterized in that, may further comprise the steps:
A, set up or open the multimedia file that comprises at least one independent paging according to default filename, described multimedia file comprises the format description information of described multimedia file, and described format description information comprises information of session description protocol and divides page information;
B, deposit multimedia information data to be stored each paging of described multimedia file in, and be divided into more than one each paging of described multimedia file independently that access unit is used to load the packet that deposits described multimedia file paging in according to described format description information.
2, multimedia information storage method according to claim 1 is characterized in that, the nested again sub-access unit of n level that is subdivided into of described access unit, and n is the integer more than or equal to 0.
3, multimedia information storage method according to claim 2 is characterized in that, described step B comprises:
B1, the sub-access unit of each n level are respectively the information packet that deposits in wherein and set up the sub-access unit index information of n level.
4, multimedia information storage method according to claim 3 is characterized in that, described step B also comprises:
B2, each sub-access unit are set up the index information of sub-access unit at the corresponding levels respectively according to the index information of the sub-access unit of its subordinate;
B3, each access unit are set up the access unit index information according to the index information of its subordinate's the 1st grade of sub-access unit respectively.
5, multimedia information storage method according to claim 4 is characterized in that, also comprises after the described step B3:
B4, each paging merge generation paging index information with the access unit index information in the described multimedia file paging.
6, multimedia information storage method according to claim 5 is characterized in that, also comprises step after the step B:
C, described paging index information merged the general index information that generates described multimedia file.
According to the described multimedia information storage method of aforementioned arbitrary claim, it is characterized in that 7, described paging information comprises:
The paging foundation, be meant the criterion of the division institute foundation of page or leaf, described criterion can be the time according to the multimedia file of storage, perhaps according to the shared space of multimedia file of storage or according to the bag quantity of the multimedia file of storage, perhaps according to the identifier of the multimedia file of storage or according to alternative document that is linked to and address location, perhaps according to the combination of above any criterion;
Paging tolerance, corresponding with the paging foundation, be used to measure the paging foundation, if the paging criterion is the shared space of multimedia file according to storage, then paging tolerance is the unit of every page space size; If the paging criterion is the time according to the multimedia file of storage, then paging tolerance is the unit of every page time span; If the paging criterion is the identifier according to the multimedia file of storage, then paging tolerance is every page identifier; If the paging criterion is alternative document and address location according to link, then paging tolerance expression is linked at information such as position in the file or appointed file name.
8, according to the arbitrary described multimedia information storage method of claim 1 to 6, it is characterized in that, the whole file of described multimedia file or paging or access unit or sub-access unit adopt standard media form or self-defining media formats, and each paging and access unit and sub-access unit adopt identical or different media formats each other.
9, a kind of multimedia messages player method is characterized in that may further comprise the steps:
D, when multimedia file by a sowing time, server reads the corresponding information of session description protocol of described multimedia file and offers client;
E, when the link establishment between client and server successfully begins to play, be positioned to minute page position at the corresponding packet place of fixed time point by general index information or by traveling through each paging index information;
F, navigate to after packet reads the position, begin, carry out the packet operation according to the condition of client setting from this packet.
10, multimedia messages player method according to claim 9 is characterized in that step e also comprises:
E1, according to described fixed time point, in current paging, search the corresponding access unit position, packet place of described fixed time point according to described paging index information or by traversal access unit index information;
E2, according to the fixed time point, in current access unit, search the corresponding sub-access unit position, packet place of described fixed time point according to described access unit index information or by traveling through sub-access unit index information;
E3, up to the sub-access unit of the n level position that is positioned to the corresponding packet place of described fixed time point.
11, multimedia messages player method according to claim 10, it is characterized in that, in the step e: if when the corresponding packet of described fixed time point is in last still incomplete paging, after then being positioned to the access unit or sub-access unit in the described imperfect paging, in current access unit or sub-access unit, searching packet and read the position; If search less than the corresponding packet of described fixed time point, then in access unit or sub-access unit, search packet and read the position forward or backward or by searching algorithm at current access unit or sub-access unit.
12, a kind of multimedia information storage device is characterized in that, comprising:
File is set up module, is used for setting up or opening a multimedia file according to default filename, and described multimedia file comprises the format description information of described multimedia file, and described format description information comprises information of session description protocol and divides page information;
Divide module, set up module with file and be connected, be used for described multimedia file being divided at least one independent paging, and each paging is divided at least one independently access unit according to described format description information;
The information conversion module is connected with the division module, is used for multimedia information data to be stored is deposited in the access unit of ready-portioned each paging of described multimedia file.
13, multimedia information storage device according to claim 12 is characterized in that, also comprises in the described division unit:
Sub-access unit is divided module, is used for according to described format description information nested at least one the independently sub-access unit of n level that is divided into of each described access unit, and n is the integer more than or equal to 0.
14, a kind of multimedia information storage device according to claim 13 is characterized in that, also comprises:
The index generation module is used for finishing at sub-access unit or access unit or paging structure the index information of the sub-access unit of after-cost or access unit or paging.
15, a kind of multimedia messages playing device is characterized in that, comprising:
The command reception module is used to receive the condition that client is provided with, and comprises concrete operations action and fixed time point to multimedia file in the described condition;
Locating module is used for being positioned to paging or the access unit or the sub-access unit of the n level position at the corresponding packet place of fixed time point according to the condition of described client setting by the index information of multimedia file, and n is the integer more than or equal to 0;
Operational module is connected with locating module, after being used to navigate to packet and reading the position, begins from this packet, carries out the packet operation according to the condition of client setting.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CNA2009101051870A CN101477575A (en) | 2009-01-22 | 2009-01-22 | Multimedia information storing and playing method and apparatus |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CNA2009101051870A CN101477575A (en) | 2009-01-22 | 2009-01-22 | Multimedia information storing and playing method and apparatus |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN101477575A true CN101477575A (en) | 2009-07-08 |
Family
ID=40838291
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CNA2009101051870A Pending CN101477575A (en) | 2009-01-22 | 2009-01-22 | Multimedia information storing and playing method and apparatus |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN101477575A (en) |
Cited By (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101895736A (en) * | 2010-07-07 | 2010-11-24 | 杭州华三通信技术有限公司 | Media stream data processing method and device thereof |
| CN102393854A (en) * | 2011-09-09 | 2012-03-28 | 杭州海康威视数字技术股份有限公司 | Method and device obtaining audio/video data |
| CN103150340A (en) * | 2013-02-05 | 2013-06-12 | 上海达梦数据库有限公司 | Fast loading system and method for multimedia data |
| CN103984278A (en) * | 2014-05-28 | 2014-08-13 | 天津瑞能电气有限公司 | Storage and quick positioning reading method for long-time multivariable monitoring data |
| CN105224546A (en) * | 2014-06-04 | 2016-01-06 | 阿里巴巴集团控股有限公司 | Data storage and query method and apparatus |
| CN105338415A (en) * | 2015-10-29 | 2016-02-17 | 北京威动科技有限公司 | File navigation playing method and device |
| CN105405457A (en) * | 2015-10-29 | 2016-03-16 | 北京威动科技有限公司 | File content reading method and device |
| CN107409130A (en) * | 2015-03-02 | 2017-11-28 | 高通股份有限公司 | Indication of partial segments |
| US20190082419A1 (en) * | 2009-10-30 | 2019-03-14 | Apple Inc. | Methods and Apparatus for Optimizing Paging Mechanisms Using Device Context Information |
| WO2019120048A1 (en) * | 2017-12-19 | 2019-06-27 | 华为技术有限公司 | Mp4 file processing method and related device therefor |
| US10749930B2 (en) | 2015-03-02 | 2020-08-18 | Qualcomm Incorporated | Indication for partial segment |
-
2009
- 2009-01-22 CN CNA2009101051870A patent/CN101477575A/en active Pending
Cited By (21)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US10568068B2 (en) * | 2009-10-30 | 2020-02-18 | Apple Inc. | Methods and apparatus for optimizing paging mechanisms using device context information |
| US20190082419A1 (en) * | 2009-10-30 | 2019-03-14 | Apple Inc. | Methods and Apparatus for Optimizing Paging Mechanisms Using Device Context Information |
| CN101895736B (en) * | 2010-07-07 | 2013-03-13 | 浙江宇视科技有限公司 | Media stream data processing method and device thereof |
| CN101895736A (en) * | 2010-07-07 | 2010-11-24 | 杭州华三通信技术有限公司 | Media stream data processing method and device thereof |
| CN102393854A (en) * | 2011-09-09 | 2012-03-28 | 杭州海康威视数字技术股份有限公司 | Method and device obtaining audio/video data |
| CN102393854B (en) * | 2011-09-09 | 2013-05-15 | 杭州海康威视数字技术股份有限公司 | Method and device obtaining audio/video data |
| CN103150340B (en) * | 2013-02-05 | 2016-06-22 | 上海达梦数据库有限公司 | The quick-loading system of multi-medium data and method |
| CN103150340A (en) * | 2013-02-05 | 2013-06-12 | 上海达梦数据库有限公司 | Fast loading system and method for multimedia data |
| CN103984278A (en) * | 2014-05-28 | 2014-08-13 | 天津瑞能电气有限公司 | Storage and quick positioning reading method for long-time multivariable monitoring data |
| CN105224546A (en) * | 2014-06-04 | 2016-01-06 | 阿里巴巴集团控股有限公司 | Data storage and query method and apparatus |
| CN105224546B (en) * | 2014-06-04 | 2020-10-30 | 创新先进技术有限公司 | Data storage and query method and equipment |
| CN107409130A (en) * | 2015-03-02 | 2017-11-28 | 高通股份有限公司 | Indication of partial segments |
| US10659507B2 (en) | 2015-03-02 | 2020-05-19 | Qualcomm Incorporated | Indication for partial segment |
| US10749930B2 (en) | 2015-03-02 | 2020-08-18 | Qualcomm Incorporated | Indication for partial segment |
| CN107409130B (en) * | 2015-03-02 | 2021-06-08 | 高通股份有限公司 | Instructions for Partial Segments |
| CN105405457A (en) * | 2015-10-29 | 2016-03-16 | 北京威动科技有限公司 | File content reading method and device |
| CN105405457B (en) * | 2015-10-29 | 2018-03-16 | 北京威动科技有限公司 | File content read method and device |
| CN105338415B (en) * | 2015-10-29 | 2018-10-23 | 北京威动科技有限公司 | file navigation playing method and device |
| CN105338415A (en) * | 2015-10-29 | 2016-02-17 | 北京威动科技有限公司 | File navigation playing method and device |
| WO2019120048A1 (en) * | 2017-12-19 | 2019-06-27 | 华为技术有限公司 | Mp4 file processing method and related device therefor |
| US11100956B2 (en) | 2017-12-19 | 2021-08-24 | Huawei Technologies Co., Ltd. | MP4 file processing method and related device |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN101477575A (en) | Multimedia information storing and playing method and apparatus | |
| US6429364B1 (en) | Data transmitting/receiving device and method | |
| US8223600B2 (en) | Network-attachable, file-accessible storage drive | |
| JP5190051B2 (en) | Method and apparatus for simplifying metadata access | |
| US7522817B2 (en) | Method and apparatus for storing content | |
| CN101193273B (en) | A storage and playing method for real time multimedia image information | |
| CN101042914B (en) | Data processing apparatus and method, data reproducing apparatus and method | |
| US20130014193A1 (en) | Information provisioning apparatus and information provisioning method | |
| CN1643605B (en) | Data recording method, data recording device, data recording medium, data reproducing method, and data reproducing device | |
| JP2008262686A (en) | Method and device for recording broadcast data | |
| CN101227602A (en) | File storing method and file playing method | |
| JP2002528785A (en) | File system that supports data sharing | |
| CN103561278A (en) | Video distribution system including progressive playback | |
| US20040170374A1 (en) | Method and apparatus for converting different format content into one or more common formats | |
| CN102497542A (en) | Video positioning playback system and method thereof | |
| US20080005028A1 (en) | Contents metadata registering method, registering system, and registering program | |
| CN101986302B (en) | Media file association method and device | |
| CN100418071C (en) | Method for establishing a media file system | |
| CN102215366A (en) | Methods and systems for generating and playing multimedia file | |
| US20040158579A1 (en) | Server side play-list | |
| US8988806B2 (en) | Tape drive buffer utilization | |
| US12190915B2 (en) | Common timeline processing for unique manifests | |
| US8369684B2 (en) | Data processing apparatus and data processing method | |
| CN102611716A (en) | Method and device for transmitting media file | |
| CN101833972B (en) | Multimedia file broadcasting control method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C12 | Rejection of a patent application after its publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20090708 |