CN102595111A - Transmission method, device and system for multi-view coding stream - Google Patents
Transmission method, device and system for multi-view coding stream Download PDFInfo
- Publication number
- CN102595111A CN102595111A CN2011100050670A CN201110005067A CN102595111A CN 102595111 A CN102595111 A CN 102595111A CN 2011100050670 A CN2011100050670 A CN 2011100050670A CN 201110005067 A CN201110005067 A CN 201110005067A CN 102595111 A CN102595111 A CN 102595111A
- Authority
- CN
- China
- Prior art keywords
- visual angle
- code stream
- mvc
- user
- relies
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 49
- 230000005540 biological transmission Effects 0.000 title claims abstract description 35
- 230000000007 visual effect Effects 0.000 claims description 462
- 238000012545 processing Methods 0.000 claims description 12
- 230000008569 process Effects 0.000 claims description 11
- 230000006870 function Effects 0.000 abstract description 5
- 238000005516 engineering process Methods 0.000 description 8
- 238000010586 diagram Methods 0.000 description 5
- 210000003323 beak Anatomy 0.000 description 2
- 230000006872 improvement Effects 0.000 description 2
- 238000012546 transfer Methods 0.000 description 2
- 230000008901 benefit Effects 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000008034 disappearance Effects 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 230000008521 reorganization Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/46—Embedding additional information in the video signal during the compression process
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
- H04N19/597—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding specially adapted for multi-view video sequence encoding
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The invention provides a transmission method of a multi-view coding (MVC) stream, a transmission device for the multi-view coding stream, and a transmission system for the multi-view coding stream. The transmission method comprises the following steps: transmitting a MVC stream by a transmitting end, along with the overall information of the MVC stream, including the total amount of viewable angles of MVC, and describing information of each viewing angle of the MVC; receiving and caching the overall information of the MVC stream by a receiving end; displaying the overall information of the MVC stream based on the order from a user of inquiring the viewable angles, so that the user can select the angle to view. By using the method provided by the invention, functions of playing selection and selectively playing on-demand videos are provided to the user, thus, the user can use in a better way, and the transmission resource can be saved.
Description
Technical field
The present invention relates to transmission method, device and the system in multimedia field, particularly a kind of multi-view coded code stream.
Background technology
Along with popularizing and Development of Multimedia Technology of broadband networks, coded format is more and more.The appearance of multi-view coded (MVC) makes the user when watching video, obtains better user experience.Immediately, real time transport protocol (Real-time Transport Protocol is called for short RTP) and motion picture expert group-MPTS (MPEG2-TS) all announce to support the carrying to the MVC code stream.And put into effect corresponding standard.H.222.0 defined multi-view coded extended description (MVC extension descriptor) among the Amendment4 at ITU-T.It describes some information of MVC stream, view_order_index_min for example, information such as view_order_index_max.
When but MPEG2-TS carries MVC, the integral body of MVC code stream is not described among the TS.Because the whole disappearance of describing causes, client can't be obtained the overall picture of MVC code stream at all when receiving the PSI information of MVC code stream, and for example, the main perspective of this MVC code stream is visual angle, rostrum or visual angle, auditorium.And prediction relies on which visual angle etc. between the visual angle of non-main perspective.Client wants to obtain these information, must resolve the code stream of MVC, analyzes its sequence parameter set information such as (SPS) and just can obtain the dependence between the visual angle.But, also can't obtain even analyze code stream about the description at visual angle.
Summary of the invention
The technical problem that the present invention will solve is; A kind of method and system of the MVC of transmission code stream overall information is provided; Can abundant visual angle relevant information be provided for the user; Can provide the user to select to play well and the function of selectivity program request, user's result of use is better, and can practice thrift transfer resource.
In order to solve the problems of the technologies described above, the present invention proposes a kind of method of sending multi-view coded MVC code stream, wherein:
Transmitting terminal also sends the overall information of said MVC code stream when sending the MVC code stream, comprising: the visual angle sum that MVC can supply watch and the descriptor at each visual angle of MVC.
Further, above-mentioned sending method also can have following characteristics:
Under the multicast scene, comprise the data at each visual angle in the MVC code stream that said transmitting terminal sends; The overall information of said MVC code stream also comprises the number at the visual angle that each visual angle relies on and the information at the visual angle that each visual angle relies on.
Further, above-mentioned sending method also can have following characteristics:
Under the program request scene, said transmitting terminal is also preserved the overall information of said MVC code stream in this locality, and said overall information also comprises the number at the visual angle that each visual angle relies on and the information at the visual angle that each visual angle relies on; And
Said transmitting terminal is receiving after the user selects to watch the instruction at visual angle; The visual angle of also watching according to user's selection; Search the number at the visual angle that said each visual angle relies on and the information at the visual angle that each visual angle relies on, obtain selecting the relevant visual angle, visual angle watched with the user; When sending the MVC code stream, only send in the said MVC code stream data at relevant visual angle, the visual angle selecting to watch with the user.
In order to solve the problems of the technologies described above, the present invention also proposes a kind of method that receives multi-view coded MVC code stream, wherein:
After receiving terminal receives the MVC code stream of the overall information that carries the MVC code stream; Therefrom obtain the also overall information of the said MVC code stream of buffer memory; Check that according to the user instruction at the visual angle that can watch shows the overall information of said MVC code stream, supply the user to select the visual angle of watching;
The overall information of said MVC code stream comprises: the visual angle sum that MVC can supply watch and the descriptor at each visual angle of MVC.
Further, above-mentioned method of reseptance also can have following characteristics:
Under the multicast scene, comprise the data at each visual angle in the MVC code stream that said receiving terminal receives; The overall information of said MVC code stream also comprises the number at the visual angle that each visual angle relies on and the information at the visual angle that each visual angle relies on;
After said receiving terminal receives the MVC code stream; Select the visual angle watch according to the user; Search the number at the visual angle of said each visual angle dependence; The information at the visual angle that relies on each visual angle obtains selecting the relevant visual angle, visual angle watched with the user, only the data at relevant visual angle, the visual angle watched with user's selection in the said MVC code stream is carried out playback process.
Further, above-mentioned method of reseptance also can have following characteristics:
Said receiving terminal sends the instruction that the user selects the visual angle according to the visual angle that the user selects to transmitting terminal; And only comprise the relevant MVC code stream of selecting with the user in visual angle in the MVC code stream that receives.
In order to solve the problems of the technologies described above, the present invention also proposes a kind of method of transmitting multi-view coded MVC code stream, wherein:
Transmitting terminal also sends the overall information of said MVC code stream when sending the MVC code stream, comprising: the visual angle sum that MVC can supply watch and the descriptor at each visual angle of MVC;
Receiving terminal receives the also overall information of the said MVC code stream of buffer memory, checks that according to the user instruction at the visual angle that can watch shows the overall information of said MVC code stream, supplies the user to select the visual angle of watching.
Further, above-mentioned transmission method also can have following characteristics:
Under the multicast scene:
The data that comprise each visual angle in the MVC code stream that said transmitting terminal sends; The overall information of said MVC code stream also comprises the number at the visual angle that each visual angle relies on and the information at the visual angle that each visual angle relies on;
After said receiving terminal receives the MVC code stream; Select the visual angle watch according to the user; Search the number at the visual angle of said each visual angle dependence; The information at the visual angle that relies on each visual angle obtains selecting the relevant visual angle, visual angle watched with the user, only the data at relevant visual angle, the visual angle watched with user's selection in the said MVC code stream is carried out playback process.
Further, above-mentioned transmission method also can have following characteristics:
Under the program request scene:
Said receiving terminal sends the instruction that the user selects the visual angle according to the visual angle that the user selects to transmitting terminal;
Said transmitting terminal is also preserved the overall information of said MVC code stream in this locality, said overall information also comprises the number at the visual angle that each visual angle relies on and the information at the visual angle that each visual angle relies on; And
Said transmitting terminal is receiving after the user selects to watch the instruction at visual angle; The visual angle of also watching according to user's selection; Search the number at the visual angle that said each visual angle relies on and the information at the visual angle that each visual angle relies on, obtain selecting the relevant visual angle, visual angle watched with the user; When sending the MVC code stream, only send in the said MVC code stream data at relevant visual angle, the visual angle selecting to watch with the user.
In order to solve the problems of the technologies described above, the present invention also proposes a kind of device that sends multi-view coded MVC code stream, comprises first sending module that is used to send the MVC code stream, also comprises:
Second sending module is used for when first sending module sends the MVC code stream, also sending the overall information of said MVC code stream, comprising: the visual angle sum that MVC can supply watch and the descriptor at each visual angle of MVC.
Further, above-mentioned dispensing device also can have following characteristics:
Under the multicast scene:
Said first sending module comprises the data at each visual angle in the MVC code stream of transmission;
Said second sending module, the overall information of the said MVC code stream of transmission also comprise the number at the visual angle that each visual angle relies on and the information at the visual angle that each visual angle relies on.
Further, above-mentioned dispensing device also can have following characteristics:
Also comprise memory module, wherein, under the program request scene:
Said memory module is preserved the overall information of said MVC code stream, and said overall information also comprises the number at the visual angle that each visual angle relies on and the information at the visual angle that each visual angle relies on; And
Said second sending module; Receiving after the user selects to watch the instruction at visual angle, also selecting the visual angle watched, from said memory module, searching the number at the visual angle that said each visual angle relies on according to the user; The information at the visual angle that relies on each visual angle; Obtain selecting the relevant visual angle, visual angle watch, when sending the MVC code stream, only send the data at relevant visual angle, the visual angle watched with user's selection in the said MVC code stream with the user.
In order to solve the problems of the technologies described above, the present invention also proposes a kind of device that receives multi-view coded MVC code stream, comprising:
Receiver module, reception carries the MVC code stream of the overall information of MVC code stream;
Parsing module obtains the also overall information of the said MVC code stream of buffer memory from said MVC code stream, the overall information of said MVC code stream comprises: the visual angle sum that MVC can supply watch and the descriptor at each visual angle of MVC; Check that according to the user instruction at the visual angle that can watch shows the overall information of said MVC code stream, supply the user to select the visual angle of watching.
Further, above-mentioned receiving system also can have following characteristics:
Also comprise play processing module, wherein, under the multicast scene:
Said receiver module comprises the data at each visual angle in the MVC code stream that receives;
Said parsing module, the overall information of the said MVC code stream that parses also comprise the number at the visual angle that each visual angle relies on and the information at the visual angle that each visual angle relies on;
Said play processing module; Link to each other with said parsing module with said receiver module respectively; Select the visual angle watch according to the user, from said parsing module, search the number at the visual angle that said each visual angle relies on and the information at the visual angle that each visual angle relies on; Obtain selecting the relevant visual angle, visual angle watch with the user, the data at the visual angle that the visual angle of watching with user's selection in the said MVC code stream that only said receiver module is received is relevant are carried out playback process.
Further, above-mentioned receiving system also can have following characteristics:
Also comprise play processing module, wherein, under the program request scene:
Said play processing module, the visual angle of selecting according to the user generates and sends the instruction that the user selects the visual angle;
Said receiver module only comprises the relevant MVC code stream of selecting with the user in visual angle in the MVC code stream that receives.
In order to solve the problems of the technologies described above, the present invention also proposes a kind of system of transmitting multi-view coded MVC code stream, comprising:
Transmitting terminal when sending the MVC code stream, also sends the overall information of said MVC code stream, comprising: the visual angle sum that MVC can supply watch and the descriptor at each visual angle of MVC;
Receiving terminal receives the also overall information of the said MVC code stream of buffer memory, checks that according to the user instruction at the visual angle that can watch shows the overall information of said MVC code stream, supplies the user to select the visual angle of watching.
Further, above-mentioned transmission system also can have following characteristics:
Under the multicast scene:
The data that comprise each visual angle in the MVC code stream that said transmitting terminal sends; The overall information of said MVC code stream also comprises the number at the visual angle that each visual angle relies on and the information at the visual angle that each visual angle relies on;
After said receiving terminal receives the MVC code stream; Select the visual angle watch according to the user; Search the number at the visual angle of said each visual angle dependence; The information at the visual angle that relies on each visual angle obtains selecting the relevant visual angle, visual angle watched with the user, only the data at relevant visual angle, the visual angle watched with user's selection in the said MVC code stream is carried out playback process.
Further, above-mentioned transmission system also can have following characteristics:
Under the program request scene:
Said receiving terminal sends the instruction that the user selects the visual angle according to the visual angle that the user selects to transmitting terminal;
Said transmitting terminal is also preserved the overall information of said MVC code stream in this locality, said overall information also comprises the number at the visual angle that each visual angle relies on and the information at the visual angle that each visual angle relies on; And
Said transmitting terminal is receiving after the user selects to watch the instruction at visual angle; The visual angle of also watching according to user's selection; Search the number at the visual angle that said each visual angle relies on and the information at the visual angle that each visual angle relies on, obtain selecting the relevant visual angle, visual angle watched with the user; When sending the MVC code stream, only send in the said MVC code stream data at relevant visual angle, the visual angle selecting to watch with the user.
A kind of method and system that transmits MVC code stream overall information provided by the invention; Can abundant visual angle relevant information be provided for the user; Can provide the user to select to play well and the function of selectivity program request, user's result of use is better, and can practice thrift transfer resource.
Description of drawings
Fig. 1 is the method flow diagram of a kind of MVC of transmission code stream of the embodiment of the invention;
Fig. 2 is the method flow diagram of transmission MVC code stream under a kind of multicast scene of the embodiment of the invention;
Fig. 3 is the method flow diagram of transmission MVC code stream under a kind of program request scene of the embodiment of the invention;
Fig. 4 is the device block diagram of a kind of MVC of transmission code stream of the embodiment of the invention;
Fig. 5 is the device block diagram of a kind of MVC of reception code stream of the embodiment of the invention;
Fig. 6 is that application example client of the present invention receives that the MPEG2-TS code stream upgrades the flow chart that the visual angle is described;
Fig. 7 is the flow chart that abandons extraneous data that application example client of the present invention is received the MPEG2-TS code stream.
Embodiment
For making the object of the invention, technical scheme and advantage clearer, will combine accompanying drawing and specific embodiment to describe the present invention below.
The embodiment of the invention provides a kind of method of the MVC of transmission code stream, and is as shown in Figure 1, comprises step:
Step S101: transmitting terminal also sends the overall information of said MVC code stream when sending the MVC code stream, can comprise: the visual angle sum that MVC can supply watch and the descriptor at each visual angle of MVC;
Wherein which angle shot is the descriptor at MVC visual angle indicate this visual angle from, and this information helps the user to select the visual angle of oneself liking.
Step S102: receiving terminal receives the also overall information of the said MVC code stream of buffer memory, checks that according to the user instruction at the visual angle that can watch shows the overall information of said MVC code stream, supplies the user to select the visual angle of watching.
When concrete the realization, transmitting terminal can be that code stream is being encapsulated as transmission package, in said transmission package, adds the whole information of describing of MVC code stream, thereby both are sent together.
The embodiment of the invention dexterously through with MVC code stream Global Information through with in mode send receiving terminal to.Receiving terminal is received behind the code stream can have a whole understanding to the MVC code stream, makes things convenient for the user that the visual angle is selected.
Preferably, the embodiment of the invention also provides a kind of method of the MVC of transmission code stream to the characteristics of multicast scene, as shown in Figure 2, comprises step:
Step S201: said transmitting terminal sends large and complete MVC code stream, comprises the data at each visual angle in the promptly said MVC code stream; The overall information of said MVC code stream also comprises the number at the visual angle that each visual angle relies on and the information at the visual angle that each visual angle relies on;
Wherein, the visual angle number of dependence indicates the sum that will resolve the visual angle that this visual angle also will reference; The visual angle information that relies on indicates this visual angle of parsing need rely on for which visual angle, and it can be realized with the form of ID.
Step S202: after said receiving terminal receives the MVC code stream; Select the visual angle watch according to the user; Search the number at the visual angle of said each visual angle dependence; The information at the visual angle that relies on each visual angle obtains selecting the relevant visual angle, visual angle watched with the user, only the data at relevant visual angle, the visual angle watched with user's selection in the said MVC code stream is carried out playback process.
When concrete the realization, receiving terminal can be discarded into and watch the code stream of view angle-independent in the code stream that receives.
The above-mentioned multicast implementation of the embodiment of the invention provides the function that the large and complete code stream of receiving is extracted, and need not resolve the SPS in the bringing onto load, could a whole understanding be arranged to code stream.As far as the user, increased the function that the user selects to watch different visual angles, improve the efficient of reorganization addressed location well.
Preferably, the embodiment of the invention also provides a kind of method of the MVC of transmission code stream to the characteristics of program request scene, as shown in Figure 3, comprises step:
Step S301: said receiving terminal sends the instruction that the user selects the visual angle according to the visual angle that the user selects to transmitting terminal;
Step S302: said transmitting terminal is preserved the overall information of said MVC code stream in this locality, and said overall information also comprises the number at the visual angle that each visual angle relies on and the information at the visual angle that each visual angle relies on;
That is, the information at the visual angle that the number at the visual angle that each visual angle relies on and each visual angle rely on is not carried on and is sent to receiving terminal in the code stream under the program request scene.
Step S303: said transmitting terminal is receiving after the user selects to watch the instruction at visual angle; The visual angle of also watching according to user's selection; Search the number at the visual angle that said each visual angle relies on and the information at the visual angle that each visual angle relies on, obtain selecting the relevant visual angle, visual angle watched with the user; When sending the MVC code stream, only send in the said MVC code stream data at relevant visual angle, the visual angle selecting to watch with the user.
The above-mentioned multicast implementation of the embodiment of the invention has enriched the selection mode of user's program request; Promptly can select the visual angle of needs; Transmitting terminal is according to user's selection, only send in the said MVC code stream data at relevant visual angle, the visual angle selecting to watch with the user, thereby bandwidth resources seen in saving greatly.
In addition, in another embodiment, the overall information of said MVC code stream can also be selected other information as required, thinks that the user provides abundanter selection, and the present invention does not limit at this.
In order to realize said method, the embodiment of the invention also provides a kind of device of the MVC of transmission code stream, and is as shown in Figure 4, comprising:
First sending module is used to send the MVC code stream;
Second sending module is used for when first sending module sends the MVC code stream, also sending the overall information of said MVC code stream, comprising: the visual angle sum that MVC can supply watch and the descriptor at each visual angle of MVC.
Preferably, under the multicast scene:
Said first sending module comprises the data at each visual angle in the MVC code stream of transmission;
Said second sending module, the overall information of the said MVC code stream of transmission also comprise the number at the visual angle that each visual angle relies on and the information at the visual angle that each visual angle relies on.
Preferably, under the program request scene, can also comprise memory module, wherein:
Said memory module under the program request scene, is preserved the overall information of said MVC code stream, and said overall information also comprises the number at the visual angle that each visual angle relies on and the information at the visual angle that each visual angle relies on; And
Said second sending module; Receiving after the user selects to watch the instruction at visual angle, also selecting the visual angle watched, from said memory module, searching the number at the visual angle that said each visual angle relies on according to the user; The information at the visual angle that relies on each visual angle; Obtain selecting the relevant visual angle, visual angle watch, when sending the MVC code stream, only send the data at relevant visual angle, the visual angle watched with user's selection in the said MVC code stream with the user.
In order to realize said method, the embodiment of the invention also provides a kind of device of the MVC of reception code stream, and is as shown in Figure 5, comprising:
Receiver module, reception carries the MVC code stream of the overall information of MVC code stream;
Parsing module obtains the also overall information of the said MVC code stream of buffer memory from said MVC code stream, the overall information of said MVC code stream comprises: the visual angle sum that MVC can supply watch and the descriptor at each visual angle of MVC; Check that according to the user instruction at the visual angle that can watch shows the overall information of said MVC code stream, supply the user to select the visual angle of watching.
Preferably, under the multicast scene, can also comprise play processing module, wherein:
Said receiver module comprises the data at each visual angle in the MVC code stream that receives;
Said parsing module, the overall information of the said MVC code stream that parses also comprise the number at the visual angle that each visual angle relies on and the information at the visual angle that each visual angle relies on;
Said play processing module; Link to each other with said parsing module with said receiver module respectively; Select the visual angle watch according to the user, from said parsing module, search the number at the visual angle that said each visual angle relies on and the information at the visual angle that each visual angle relies on; Obtain selecting the relevant visual angle, visual angle watch with the user, the data at the visual angle that the visual angle of watching with user's selection in the said MVC code stream that only said receiver module is received is relevant are carried out playback process.
Preferably, under the program request scene, can also comprise play processing module, wherein:
Said play processing module, the visual angle of selecting according to the user generates and sends the instruction that the user selects the visual angle;
Said receiver module only comprises the relevant MVC code stream of selecting with the user in visual angle in the MVC code stream that receives.
In order to realize said method, the embodiment of the invention also provides a kind of system, comprises transmitting terminal and receiving terminal, wherein:
Said transmitting terminal when sending the MVC code stream, also sends the overall information of said MVC code stream, comprising: the visual angle sum that MVC can supply watch and the descriptor at each visual angle of MVC;
Said receiving terminal receives the also overall information of the said MVC code stream of buffer memory, checks that according to the user instruction at the visual angle that can watch shows the overall information of said MVC code stream, supplies the user to select the visual angle of watching.
Preferably, under the multicast scene:
The data that comprise each visual angle in the MVC code stream that said transmitting terminal sends; The overall information of said MVC code stream also comprises the number at the visual angle that each visual angle relies on and the information at the visual angle that each visual angle relies on;
After said receiving terminal receives the MVC code stream; Select the visual angle watch according to the user; Search the number at the visual angle of said each visual angle dependence; The information at the visual angle that relies on each visual angle obtains selecting the relevant visual angle, visual angle watched with the user, only the data at relevant visual angle, the visual angle watched with user's selection in the said MVC code stream is carried out playback process.
Preferably, under the program request scene:
Said receiving terminal sends the instruction that the user selects the visual angle according to the visual angle that the user selects to transmitting terminal;
Said transmitting terminal is also preserved the overall information of said MVC code stream in this locality, said overall information also comprises the number at the visual angle that each visual angle relies on and the information at the visual angle that each visual angle relies on; And
Said transmitting terminal is receiving after the user selects to watch the instruction at visual angle; The visual angle of also watching according to user's selection; Search the number at the visual angle that said each visual angle relies on and the information at the visual angle that each visual angle relies on, obtain selecting the relevant visual angle, visual angle watched with the user; When sending the MVC code stream, only send in the said MVC code stream data at relevant visual angle, the visual angle selecting to watch with the user.
In order to further specify implementation of the present invention, the present invention describes with a concrete application example at this:
Application example 1
Should use instance is that MPEG2-TS carrying MVC is the basis.Under multicast environment, what transmitting terminal sent is the large and complete code stream of MVC, promptly comprises the code stream at each visual angle.Transmitting terminal sends the code stream that comprises mvc-total_descriptor.
In PMT, increase the mvc_total_descriptor of a program level, define as follows:
Wherein the implication of each field is following:
ViewNum: show the number that comprises view in this MVC code stream.
ViewID: the sign at visual angle.
ViewDescription: the description at visual angle.
DependViewNum: the number at the visual angle that this visual angle relies on.
PidOfDependView: the PID of the place son stream at the visual angle that this visual angle relies on.
Wherein viewNum, viewID, viewDescription are essential.DependViewNum and dependViewId are Optional Fields.
Of Fig. 6, provided an application scenarios that utilizes the MPEG2-TS mvc_total_descriptor of above-mentioned expansion.Wherein all equipment is all supported in the present technique scheme expansion to MPEG2-TS.
Step S601: client receives the TS data;
Step S602: judge whether the data receive are the PSI data, if, execution in step S603 then; If deny, then execution in step S604;
Step S603: resolve the PSI data, the description at the visual angle that the renewal user can watch;
Step S604: visual angle and description thereof that whether explicit user can be watched, for example identify the operation that user's button click is inquired about the visual angle that can watch, then execution in step S605;
Step S605: visual angle that demonstration can be watched and description thereof for example show:
Visual angle one: visual angle, rostrum
Visual angle two: LOOK LEFT
Visual angle three: LOOK RIGHT
Step S606: the user is according to the visual angle that shows and describe its visual angle that will watch of selection.
Of Fig. 7, provided an application scenarios that utilizes the MPEG-2TSmvc_total_descriptor of above-mentioned expansion, wherein all equipment is all supported in the present technique scheme expansion to MPEG-2TS.At first equipment such as encoder or higher level's server carries out multicast/broadcast with the live MVC code stream of the MPEG-2TS that has increased mvc_total_descriptor through communication network.The forwarding unit at edge, for example server or forwarding unit that can perceptible medium, receive this multicast code stream after, again it is transmitted to the terminal.
Step S701: client receives the TS data;
Step S702: judge whether receive the TS data accomplishes, if, then finish, otherwise execution in step S703;
Step S703: judge whether the data receive are the PSI data, if, execution in step S704 then, otherwise, execution in step S705;
Step S704: resolve the mvc_total_descriptor that expands among the PSI, upgrade the visual angle kind that the user can watch;
Step S705: whether judges has been switched is watched the visual angle, if then execution in step S706 goes on foot, otherwise, execution in step S707;
Step S706:, upgrade the PID at the visual angle that new visual angle relies on according to mvc_total_descriptor;
Step S707: discard code stream with user-selected view angle-independent;
Step S708: to each substreams permutatation of MVC, decoding also shows, returns step S701.
The above only is a preferred implementation of the present invention.For the technical staff in present technique field, under the prerequisite that does not break away from the principle of the invention, can also make some improvement and retouching, these improvement and retouching also should be regarded as protection scope of the present invention.
Claims (18)
1. method of sending multi-view coded MVC code stream is characterized in that:
Transmitting terminal also sends the overall information of said MVC code stream when sending the MVC code stream, comprising: the visual angle sum that MVC can supply watch and the descriptor at each visual angle of MVC.
2. sending method as claimed in claim 1 is characterized in that:
Under the multicast scene, comprise the data at each visual angle in the MVC code stream that said transmitting terminal sends; The overall information of said MVC code stream also comprises the number at the visual angle that each visual angle relies on and the information at the visual angle that each visual angle relies on.
3. sending method as claimed in claim 1 is characterized in that:
Under the program request scene, said transmitting terminal is also preserved the overall information of said MVC code stream in this locality, and said overall information also comprises the number at the visual angle that each visual angle relies on and the information at the visual angle that each visual angle relies on; And
Said transmitting terminal is receiving after the user selects to watch the instruction at visual angle; The visual angle of also watching according to user's selection; Search the number at the visual angle that said each visual angle relies on and the information at the visual angle that each visual angle relies on, obtain selecting the relevant visual angle, visual angle watched with the user; When sending the MVC code stream, only send in the said MVC code stream data at relevant visual angle, the visual angle selecting to watch with the user.
4. method that receives multi-view coded MVC code stream is characterized in that:
After receiving terminal receives the MVC code stream of the overall information that carries the MVC code stream; Therefrom obtain the also overall information of the said MVC code stream of buffer memory; Check that according to the user instruction at the visual angle that can watch shows the overall information of said MVC code stream, supply the user to select the visual angle of watching;
The overall information of said MVC code stream comprises: the visual angle sum that MVC can supply watch and the descriptor at each visual angle of MVC.
5. method of reseptance as claimed in claim 4 is characterized in that:
Under the multicast scene, comprise the data at each visual angle in the MVC code stream that said receiving terminal receives; The overall information of said MVC code stream also comprises the number at the visual angle that each visual angle relies on and the information at the visual angle that each visual angle relies on;
After said receiving terminal receives the MVC code stream; Select the visual angle watch according to the user; Search the number at the visual angle of said each visual angle dependence; The information at the visual angle that relies on each visual angle obtains selecting the relevant visual angle, visual angle watched with the user, only the data at relevant visual angle, the visual angle watched with user's selection in the said MVC code stream is carried out playback process.
6. method of reseptance as claimed in claim 4 is characterized in that:
Said receiving terminal sends the instruction that the user selects the visual angle according to the visual angle that the user selects to transmitting terminal; And only comprise the relevant MVC code stream of selecting with the user in visual angle in the MVC code stream that receives.
One kind the transmission multi-view coded MVC code stream method, it is characterized in that:
Transmitting terminal also sends the overall information of said MVC code stream when sending the MVC code stream, comprising: the visual angle sum that MVC can supply watch and the descriptor at each visual angle of MVC;
Receiving terminal receives the also overall information of the said MVC code stream of buffer memory, checks that according to the user instruction at the visual angle that can watch shows the overall information of said MVC code stream, supplies the user to select the visual angle of watching.
8. transmission method as claimed in claim 7 is characterized in that, under the multicast scene:
The data that comprise each visual angle in the MVC code stream that said transmitting terminal sends; The overall information of said MVC code stream also comprises the number at the visual angle that each visual angle relies on and the information at the visual angle that each visual angle relies on;
After said receiving terminal receives the MVC code stream; Select the visual angle watch according to the user; Search the number at the visual angle of said each visual angle dependence; The information at the visual angle that relies on each visual angle obtains selecting the relevant visual angle, visual angle watched with the user, only the data at relevant visual angle, the visual angle watched with user's selection in the said MVC code stream is carried out playback process.
9. transmission method as claimed in claim 7 is characterized in that, under the program request scene:
Said receiving terminal sends the instruction that the user selects the visual angle according to the visual angle that the user selects to transmitting terminal;
Said transmitting terminal is also preserved the overall information of said MVC code stream in this locality, said overall information also comprises the number at the visual angle that each visual angle relies on and the information at the visual angle that each visual angle relies on; And
Said transmitting terminal is receiving after the user selects to watch the instruction at visual angle; The visual angle of also watching according to user's selection; Search the number at the visual angle that said each visual angle relies on and the information at the visual angle that each visual angle relies on, obtain selecting the relevant visual angle, visual angle watched with the user; When sending the MVC code stream, only send in the said MVC code stream data at relevant visual angle, the visual angle selecting to watch with the user.
10. a device that sends multi-view coded MVC code stream comprises first sending module that is used to send the MVC code stream, it is characterized in that, also comprises:
Second sending module is used for when first sending module sends the MVC code stream, also sending the overall information of said MVC code stream, comprising: the visual angle sum that MVC can supply watch and the descriptor at each visual angle of MVC.
11. dispensing device as claimed in claim 10 is characterized in that, under the multicast scene:
Said first sending module comprises the data at each visual angle in the MVC code stream of transmission;
Said second sending module, the overall information of the said MVC code stream of transmission also comprise the number at the visual angle that each visual angle relies on and the information at the visual angle that each visual angle relies on.
12. dispensing device as claimed in claim 10 is characterized in that, also comprises memory module, wherein, and under the program request scene:
Said memory module is preserved the overall information of said MVC code stream, and said overall information also comprises the number at the visual angle that each visual angle relies on and the information at the visual angle that each visual angle relies on; And
Said second sending module; Receiving after the user selects to watch the instruction at visual angle, also selecting the visual angle watched, from said memory module, searching the number at the visual angle that said each visual angle relies on according to the user; The information at the visual angle that relies on each visual angle; Obtain selecting the relevant visual angle, visual angle watch, when sending the MVC code stream, only send the data at relevant visual angle, the visual angle watched with user's selection in the said MVC code stream with the user.
13. a device that receives multi-view coded MVC code stream is characterized in that, comprising:
Receiver module, reception carries the MVC code stream of the overall information of MVC code stream;
Parsing module obtains the also overall information of the said MVC code stream of buffer memory from said MVC code stream, the overall information of said MVC code stream comprises: the visual angle sum that MVC can supply watch and the descriptor at each visual angle of MVC; Check that according to the user instruction at the visual angle that can watch shows the overall information of said MVC code stream, supply the user to select the visual angle of watching.
14. receiving system as claimed in claim 13 is characterized in that, also comprises play processing module, wherein, and under the multicast scene:
Said receiver module comprises the data at each visual angle in the MVC code stream that receives;
Said parsing module, the overall information of the said MVC code stream that parses also comprise the number at the visual angle that each visual angle relies on and the information at the visual angle that each visual angle relies on;
Said play processing module; Link to each other with said parsing module with said receiver module respectively; Select the visual angle watch according to the user, from said parsing module, search the number at the visual angle that said each visual angle relies on and the information at the visual angle that each visual angle relies on; Obtain selecting the relevant visual angle, visual angle watch with the user, the data at the visual angle that the visual angle of watching with user's selection in the said MVC code stream that only said receiver module is received is relevant are carried out playback process.
15. receiving system as claimed in claim 13 is characterized in that, also comprises play processing module, wherein, and under the program request scene:
Said play processing module, the visual angle of selecting according to the user generates and sends the instruction that the user selects the visual angle;
Said receiver module only comprises the relevant MVC code stream of selecting with the user in visual angle in the MVC code stream that receives.
16. the system of the multi-view coded MVC code stream of transmission is characterized in that, comprising:
Transmitting terminal when sending the MVC code stream, also sends the overall information of said MVC code stream, comprising: the visual angle sum that MVC can supply watch and the descriptor at each visual angle of MVC;
Receiving terminal receives the also overall information of the said MVC code stream of buffer memory, checks that according to the user instruction at the visual angle that can watch shows the overall information of said MVC code stream, supplies the user to select the visual angle of watching.
17. transmission system as claimed in claim 16 is characterized in that, under the multicast scene:
The data that comprise each visual angle in the MVC code stream that said transmitting terminal sends; The overall information of said MVC code stream also comprises the number at the visual angle that each visual angle relies on and the information at the visual angle that each visual angle relies on;
After said receiving terminal receives the MVC code stream; Select the visual angle watch according to the user; Search the number at the visual angle of said each visual angle dependence; The information at the visual angle that relies on each visual angle obtains selecting the relevant visual angle, visual angle watched with the user, only the data at relevant visual angle, the visual angle watched with user's selection in the said MVC code stream is carried out playback process.
18. transmission system as claimed in claim 16 is characterized in that, under the program request scene:
Said receiving terminal sends the instruction that the user selects the visual angle according to the visual angle that the user selects to transmitting terminal;
Said transmitting terminal is also preserved the overall information of said MVC code stream in this locality, said overall information also comprises the number at the visual angle that each visual angle relies on and the information at the visual angle that each visual angle relies on; And
Said transmitting terminal is receiving after the user selects to watch the instruction at visual angle; The visual angle of also watching according to user's selection; Search the number at the visual angle that said each visual angle relies on and the information at the visual angle that each visual angle relies on, obtain selecting the relevant visual angle, visual angle watched with the user; When sending the MVC code stream, only send in the said MVC code stream data at relevant visual angle, the visual angle selecting to watch with the user.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2011100050670A CN102595111A (en) | 2011-01-11 | 2011-01-11 | Transmission method, device and system for multi-view coding stream |
| PCT/CN2012/070189 WO2012094986A1 (en) | 2011-01-11 | 2012-01-10 | Method, device and system for transmitting multi-view coding (mvc) code stream |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2011100050670A CN102595111A (en) | 2011-01-11 | 2011-01-11 | Transmission method, device and system for multi-view coding stream |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN102595111A true CN102595111A (en) | 2012-07-18 |
Family
ID=46483268
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN2011100050670A Pending CN102595111A (en) | 2011-01-11 | 2011-01-11 | Transmission method, device and system for multi-view coding stream |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN102595111A (en) |
| WO (1) | WO2012094986A1 (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2014183539A1 (en) * | 2013-11-14 | 2014-11-20 | 中兴通讯股份有限公司 | Session setup method and apparatus, and session content delivery method and apparatus |
| CN107959861A (en) * | 2016-10-18 | 2018-04-24 | 华为技术有限公司 | A kind of data processing method, relevant device and system |
| CN115086635A (en) * | 2021-03-15 | 2022-09-20 | 腾讯科技（深圳）有限公司 | Method, device and equipment for processing multi-view video and storage medium |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1694529A (en) * | 2005-06-28 | 2005-11-09 | 清华大学 | Transmission method of video stream in interactive multi-viewpoint video system |
| CN101540652A (en) * | 2009-04-09 | 2009-09-23 | 上海交通大学 | Terminal heterogeneous self-matching transmission method of multi-angle video Flow |
| WO2010030087A2 (en) * | 2008-09-10 | 2010-03-18 | Samsung Electronics Co,. Ltd. | Method and apparatus for transmitting content and method and apparatus for recording content |
Family Cites Families (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR100475060B1 (en) * | 2002-08-07 | 2005-03-10 | 한국전자통신연구원 | The multiplexing method and its device according to user's request for multi-view 3D video |
| US20070103558A1 (en) * | 2005-11-04 | 2007-05-10 | Microsoft Corporation | Multi-view video delivery |
| ES2721506T3 (en) * | 2007-01-04 | 2019-08-01 | Interdigital Madison Patent Holdings | Methods and apparatus for multi-view information, expressed in high-level syntax |
| CN100588250C (en) * | 2007-02-05 | 2010-02-03 | 北京大学 | Method and system for free-viewpoint video reconstruction of multi-viewpoint video stream |
| CN101472190B (en) * | 2007-12-28 | 2013-01-23 | 华为终端有限公司 | Multi-visual angle filming and image processing apparatus and system |
-
2011
- 2011-01-11 CN CN2011100050670A patent/CN102595111A/en active Pending
-
2012
- 2012-01-10 WO PCT/CN2012/070189 patent/WO2012094986A1/en active Application Filing
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1694529A (en) * | 2005-06-28 | 2005-11-09 | 清华大学 | Transmission method of video stream in interactive multi-viewpoint video system |
| WO2010030087A2 (en) * | 2008-09-10 | 2010-03-18 | Samsung Electronics Co,. Ltd. | Method and apparatus for transmitting content and method and apparatus for recording content |
| CN101540652A (en) * | 2009-04-09 | 2009-09-23 | 上海交通大学 | Terminal heterogeneous self-matching transmission method of multi-angle video Flow |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2014183539A1 (en) * | 2013-11-14 | 2014-11-20 | 中兴通讯股份有限公司 | Session setup method and apparatus, and session content delivery method and apparatus |
| CN104639518A (en) * | 2013-11-14 | 2015-05-20 | 中兴通讯股份有限公司 | Session building method and device and session content delivering method and device |
| CN107959861A (en) * | 2016-10-18 | 2018-04-24 | 华为技术有限公司 | A kind of data processing method, relevant device and system |
| CN107959861B (en) * | 2016-10-18 | 2020-08-25 | 华为技术有限公司 | Data processing method, related equipment and system |
| CN115086635A (en) * | 2021-03-15 | 2022-09-20 | 腾讯科技（深圳）有限公司 | Method, device and equipment for processing multi-view video and storage medium |
| WO2022193875A1 (en) * | 2021-03-15 | 2022-09-22 | 腾讯科技（深圳）有限公司 | Method and apparatus for processing multi-viewing-angle video, and device and storage medium |
| CN115086635B (en) * | 2021-03-15 | 2023-04-14 | 腾讯科技（深圳）有限公司 | Multi-view video processing method, device and equipment and storage medium |
| US12323569B2 (en) | 2021-03-15 | 2025-06-03 | Tencent Technology (Shenzhen) Company Limited | Method and apparatus for processing multi-view video with region information from view group |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2012094986A1 (en) | 2012-07-19 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| KR102529711B1 (en) | Receiving device, transmitting device, and data processing method | |
| US9351028B2 (en) | Wireless 3D streaming server | |
| US12035020B2 (en) | Split rendering of extended reality data over 5G networks | |
| KR101689050B1 (en) | Information processing device, data management method, and recording medium | |
| US10771832B2 (en) | Information processing apparatus, information processing method, program, application information table supplying apparatus, and application information table supplying method | |
| CN101772940B (en) | Apparatus, systems and methods to synchronize communication of content to a presentation device and a mobile device | |
| CN106507186B (en) | Media information switching method, server and storage medium | |
| CN106227492B (en) | Combination and mobile intelligent terminal interconnected method and device | |
| CN1964239A (en) | Apparatus and method for transmitting and receiving of broadcasting and communication combined service information | |
| KR20090076032A (en) | Method and apparatus for providing additional image information using visible light communication | |
| WO2022017149A1 (en) | Video processing method for virtual reality (vr) scene, and related device | |
| KR20070041285A (en) | Preferred Channel Management Device and Method in Mobile Broadcasting System | |
| AU2014230438A1 (en) | Distribution control system, distribution control method, and computer-readable storage medium | |
| US20110090970A1 (en) | Terminal and relay node for video conference system | |
| AU2014230422A1 (en) | Distribution control system, distribution control method, and computer-readable storage medium | |
| US11089073B2 (en) | Method and device for sharing multimedia content | |
| CN108600239A (en) | Data synthesis method and device, client, server | |
| CN112804471A (en) | Video conference method, conference terminal, server and storage medium | |
| EP3799044B1 (en) | Transmission device, transmission method, reception device and reception method | |
| KR101769353B1 (en) | Augmented broadcasting stream transmission device and method, and augmented broadcasting service providing device and method | |
| JP2016532969A (en) | Related content processing method and system | |
| US20130291011A1 (en) | Transcoding server and method for overlaying image with additional information therein | |
| CN102595111A (en) | Transmission method, device and system for multi-view coding stream | |
| KR20100134319A (en) | Method, mobile transmission device, server device and system for providing mobile live service | |
| JP6238428B2 (en) | Receiver and broadcasting device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C02 | Deemed withdrawal of patent application after publication (patent law 2001) | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20120718 |