[go: up one dir, main page]

CN102340690A - Interactive television program system and realization method - Google Patents

Interactive television program system and realization method Download PDF

Info

Publication number
CN102340690A
CN102340690A CN2011102680171A CN201110268017A CN102340690A CN 102340690 A CN102340690 A CN 102340690A CN 2011102680171 A CN2011102680171 A CN 2011102680171A CN 201110268017 A CN201110268017 A CN 201110268017A CN 102340690 A CN102340690 A CN 102340690A
Authority
CN
China
Prior art keywords
interactive
program
signal
equipment
programme
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN2011102680171A
Other languages
Chinese (zh)
Inventor
沈震群
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
SUZHOU IMADY TECHNOLOGIES CO LTD
Original Assignee
SUZHOU IMADY TECHNOLOGIES CO LTD
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by SUZHOU IMADY TECHNOLOGIES CO LTD filed Critical SUZHOU IMADY TECHNOLOGIES CO LTD
Priority to CN2011102680171A priority Critical patent/CN102340690A/en
Publication of CN102340690A publication Critical patent/CN102340690A/en
Pending legal-status Critical Current

Links

Images

Landscapes

  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

The invention discloses an interactive television program system, which comprises a studio production center and client equipment. The client equipment comprises motion capturing equipment, display equipment and computing equipment. The studio production center and the motion capturing equipment are connected with an interactive program synthesis server by the Internet respectively. The interactive program synthesis server is connected with a super rendering computer which is connected with a television transmitting tower. The television transmitting tower transmits signals to the client equipment. The system realizes highly real-time interactive television programs; only skeleton motion information and expression information are acquired at a user end, so a data volume is far lower than that of video signals and favorability for realizing three-dimensional interactive television programs under band limited conditions is achieved; the programs can be watched from any visual angle, so limitations that the conventional television programs only can be watched along with angles of field cameras and that watching effects cannot controlled automatically are broken.

Description

A kind of interactive TV program system and implementation method
 
Technical field
The present invention relates to a kind of technological implementation method of TV programme, concrete a kind of interactive TV program system and the implementation method of relating to.
Background technology
Conventional television signal is the One-to-All Broadcast mode, and therefore, spectators can only passive watch programs, only is limited to for the interaction capability of program and selects different program channels.The appearance of IPTV technology has improved the degree of freedom that spectators select for program, and has the ability of reverse transmission data to a certain extent, but does not change programme to the essence of broadcasting, and therefore many IPTV praise oneself as " interactive TV " and imprecise.
Some TV programme also has certain interactive, the program of particularly broadcasting live.Mode according to program making is different, can be divided into interactive two types of real-time interactive and non real-time.The real-time interactive program is based on on-the-spot broadcasting, and through phone, short message, perhaps mode such as internet video, online message software with part spectators' information access program making center, and is relayed to other spectators in real time.The non real-time interactive program then is the interactive signal that when program making, inserts spectators, relays through after the post-production again.
Along with the expansion day by day and the improvement of internet infrastructure, the network bandwidth obviously promotes, and has driven the development of digital high-definition television technology.Following digital network, speech communication network and TV network present combination trend, the unification of three nets of promptly widely knowing.Yet the emphasis of unification of three nets at present is to provide more high definition, magnanimity program mostly, freely selects aspects such as program, value-added service function, does not consider the essence improvement interactive to TV programme.
In addition, TV station has gradually adopted the technology of virtual studio when making type of performing in a radio or TV programme program, but this type technology lays particular emphasis on the making virtual field, because network facet technology is immature, not to the function of the long-range access of the many clients of development.
Summary of the invention
For improving the shortcoming of traditional so-called interactive TV, the present invention aims to provide a kind of implementation method of interactive TV, and this invention can realize the real-time interactive type TV programme of height, and spectators watch, but further become the part of TV programme.
For realizing above-mentioned technical purpose; Reach above-mentioned technique effect; The present invention realizes through following technical scheme: a kind of interactive TV program system; Comprise and perform in a radio or TV programme the making center and the said client device of client device comprises motion capture equipment, display device and computing equipment, said making center and the said motion capture equipment of performing in a radio or TV programme is respectively through Internet connection one interactive program synthesis server, and said interactive program synthesis server connects the super computer of playing up; The said super computer of playing up connects television transmitting tower, and said television transmitting tower sends signal for said client device.
A kind of implementation method of interactive TV program may further comprise the steps:
Step 1) is gathered the signal that program is performed in a radio or TV programme the making center, transfers to the interactive program synthesis server;
Step 2) obtains all or segment distal spectators' signals such as the action of limbs bone, expression, voice through motion capture equipment, transfer to said interactive program synthesis server with the form of Streaming Media;
The said interactive program synthesis server of step 3) makes up on-the-spot and far-end spectators' the action of limbs bone, expression, voice signal according to rules specific; And the signal after will handling sends it back the user terminal of appointment, also total data is sent to the super computer of playing up simultaneously;
The real-time composite signal stream that the said client device of step 4) will be received bundlees with personage's contour model of preserving in advance; And synthetic with the vision signal of transmitting the scene that perhaps makes from the studio of interactive program synthesis server, appear again with the three-dimension virtual reality technology.
The said super computer of playing up of step 5) reorganizes various data and signal, calculate and plays up back output conventional video signals with certain rule and is sent to TV program broadcasting system;
Vision signal stream distribution after the said TV program broadcasting system of step 6) will synthesize, be sent to all client devices and ordinary tv programme rating terminal equipment;
The signal of further, performing in a radio or TV programme the making center in the said step 1 comprises vision signal and bone actuating signal.
Further, TV program broadcasting system comprises forms such as television transmitting tower, cable TV, satellite television, internet video and IPTV described in said step 5 and the step 6.
Principle of the present invention is following: " interactive TV " implication is for the producer, the person of performing in a radio or TV programme and the spectators that allow program can fully exchange in program making and broadcast process, the interactive and form of tv programmes of participating in.The participant that interactive TV program comprised comprises live show producer, on-the-spot impresario and audience, and the participant that the remote interaction TV programme are comprised also should comprise the far-end program audience.
Motion capture technology is through methods such as dimensional measurement, space orientation and bearing measurements, and the continuous position information of the crucial bone node of trace trap human body is passed through after the Computer Processing to obtaining simplifying skeletal system in three-dimensional coordinate data again.The motion capture technology can be applied in cartoon making, recreation, virtual emulation, motion analysis, biomethanics, fields such as human engineering.
The expression capturing technology then lays particular emphasis on the exercise data of the facial crucial muscle of tracker, obtains expression shape change information.
The skeleton action and the expression information that collect can carry out virtual synthesizing through the three dimensional computer graphics technology, and through being reduced into the motion video of virtual portrait after playing up.Owing to can arbitrarily synthesize the figure action of any profile, modern film has adopted action and expression capturing technology to make science fiction, move, have dangerous camera lens in a large number.Such as the action camera lens among the film A Fanda, have above 60% and obtain and generate through action and expression capturing technology coupled computer graph technology, surpassed the proportion of traditional photography.
Making, studio centre: can adopt comparatively action, the expression capturing technology of specialty.These equipment are comparatively expensive, but output effect is good, and the film special efficacy that is generally used for high investment is in the past made.This year, not only cost declined to a great extent along with the maturation of technology, some solutions that are more prone to use also occurred, and such as the motion capture equipment of Stage company, can allow the traced person to need not to wear special-purpose tight and gauge point.
User side: the Kinect equipment that Microsoft released in 2010 is actually the easy motion capture equipment of a kind of economy; Utilize depth map to obtain technology; Personage in the scene domain is carried out track identification, and, can get access to three-dimensional skeleton action message through certain intelligent signal processing.In addition, association, Asus also all will release similar products in 2011.Kinect surpasses 10,000,000 at global sales in March, 2011, has therefore had very high user's popularity.
Software: PC computer and game host have had powerful 3-D graphic disposal ability at present, are equipped with suitable software, can generate and highly intend genuine three-dimensional true environment.Similar techniques has been widely used in the three-dimensional electronic recreation, has quite high technology maturity.Utilize these technology as framework, suitably redevelop, promptly can reach the target of three-dimensional interactive TV.
Compared with prior art, the present invention has following beneficial effect:
1, through the reverse information that transmits the user, with the program synchronization interactive at the studio or the center of making, obtained remote audience and making center are connected to the effect of virtual three dimensional space, realize real-time interactive type TV programme highly; Spectators watch, but further become the part of TV programme.
2, only gather bone action message and expression information at user side, data volume is far smaller than vision signal, helps under the finite bandwidth condition, realizing the three-dimensional interactive TV programme;
3, the bone action and the expression information that collect are played up through the three dimensional computer graphics mode again, can generate 3-D graphic, and can watch from any visual angle through the mode of virtual video camera, conveniently carry out the synthetic and processing of whole virtual scene;
4, in theory; If studio centre, viewer end all adopt under the situation of three-dimensional virtual scene, three dimensional character model, three-dimensional bone action message; Can realize watching program, break through the traditional tv program and can only watch with the field camera angle, can't oneself control the limitation of viewing effect from any visual angle.
Description of drawings
Accompanying drawing described herein is used to provide further understanding of the present invention, constitutes the application's a part, and illustrative examples of the present invention and explanation thereof are used to explain the present invention, do not constitute improper qualification of the present invention.In the accompanying drawings:
Fig. 1 shows system configuration sketch map of the present invention .
Label declaration among the figure: 1, perform in a radio or TV programme the making center, 2, client device, 3, motion capture equipment, 4, display device, 5, computing equipment, 6, the interactive program synthesis server, 7, the super computer of playing up, 8, television transmitting tower.
Embodiment
Below with reference to accompanying drawing and combine embodiment, specify the present invention.
Referring to shown in Figure 1; A kind of interactive TV program system; Comprise and perform in a radio or TV programme making center 1 and client device 2; Said client device 1 comprises motion capture equipment 3, display device 4 and computing equipment 5, and said making center 1 and the said motion capture equipment 3 of performing in a radio or TV programme is respectively through Internet connection one interactive program synthesis server 6, the super computer 7 of playing up of said interactive program synthesis server 6 connections; The said super computer 7 of playing up connects television transmitting tower 8, and said television transmitting tower 8 sends signal for said client device 2.
A kind of implementation method of interactive TV program may further comprise the steps:
Step 1) is gathered the signal that program is performed in a radio or TV programme the making center, transfers to the interactive program synthesis server;
Step 2) obtains all or segment distal spectators' signals such as the action of limbs bone, expression, voice through motion capture equipment, transfer to said interactive program synthesis server with the form of Streaming Media;
The said interactive program synthesis server of step 3) makes up on-the-spot and far-end spectators' the action of limbs bone, expression, voice signal according to rules specific; And the signal after will handling sends it back the user terminal of appointment, also total data is sent to the super computer of playing up simultaneously;
The real-time composite signal stream that the said client device of step 4) will be received bundlees with personage's contour model of preserving in advance; And synthetic with the vision signal of transmitting the scene that perhaps makes from the studio of interactive program synthesis server, appear again with the three-dimension virtual reality technology.
The said super computer of playing up of step 5) reorganizes various data and signal, calculate and plays up back output conventional video signals with certain rule and is sent to TV program broadcasting system;
Vision signal stream distribution after the said TV program broadcasting system of step 6) will synthesize, be sent to all client devices and ordinary tv programme rating terminal equipment;
The signal of further, performing in a radio or TV programme the making center in the said step 1 comprises vision signal and bone actuating signal.
Further, TV program broadcasting system comprises forms such as television transmitting tower, cable TV, satellite television, internet video and IPTV described in said step 5 and the step 6.

Claims (4)

1. interactive TV program system; Comprise and perform in a radio or TV programme making center (1) and client device (2); It is characterized in that: said client device (1) comprises motion capture equipment (3), display device (4) and computing equipment (5); Said making center (1) and the said motion capture equipment (3) of performing in a radio or TV programme is respectively through Internet connection one interactive program synthesis server (6); Said interactive program synthesis server (6) connects the super computer (7) of playing up, and the said super computer (7) of playing up connects television transmitting tower (8), and said television transmitting tower (8) sends signal for said client device (2).
2. the implementation method of an interactive TV program is characterized in that, may further comprise the steps:
Step 1) is gathered the signal that program is performed in a radio or TV programme the making center, transfers to the interactive program synthesis server;
Step 2) obtains all or segment distal spectators' signals such as the action of limbs bone, expression, voice through motion capture equipment, transfer to said interactive program synthesis server with the form of Streaming Media;
The said interactive program synthesis server of step 3) makes up on-the-spot and far-end spectators' the action of limbs bone, expression, voice signal according to rules specific; And the signal after will handling sends it back the user terminal of appointment, also total data is sent to the super computer of playing up simultaneously;
The real-time composite signal stream that the said client device of step 4) will be received bundlees with personage's contour model of preserving in advance; And synthetic with the vision signal of transmitting the scene that perhaps makes from the studio of interactive program synthesis server, appear again with the three-dimension virtual reality technology.
3. the said super computer of playing up of step 5) reorganizes various data and signal, calculate and plays up back output conventional video signals with certain rule and is sent to TV program broadcasting system;
Vision signal stream distribution after the said TV program broadcasting system of step 6) will synthesize, be sent to all client devices and ordinary tv programme rating terminal equipment;
The implementation method of interactive TV according to claim 2 is characterized in that: the signal of performing in a radio or TV programme the making center in the said step 1 comprises vision signal and bone actuating signal.
4. the implementation method of interactive TV according to claim 2, it is characterized in that: TV program broadcasting system comprises forms such as television transmitting tower, cable TV, satellite television, internet video and IPTV described in said step 5 and the step 6.
CN2011102680171A 2011-09-13 2011-09-13 Interactive television program system and realization method Pending CN102340690A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN2011102680171A CN102340690A (en) 2011-09-13 2011-09-13 Interactive television program system and realization method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN2011102680171A CN102340690A (en) 2011-09-13 2011-09-13 Interactive television program system and realization method

Publications (1)

Publication Number Publication Date
CN102340690A true CN102340690A (en) 2012-02-01

Family

ID=45516163

Family Applications (1)

Application Number Title Priority Date Filing Date
CN2011102680171A Pending CN102340690A (en) 2011-09-13 2011-09-13 Interactive television program system and realization method

Country Status (1)

Country Link
CN (1) CN102340690A (en)

Cited By (19)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102685461A (en) * 2012-05-22 2012-09-19 深圳市环球数码创意科技有限公司 Method and system for realizing real-time audience interaction
CN103179437A (en) * 2013-03-15 2013-06-26 苏州跨界软件科技有限公司 System and method for recording and playing virtual character videos
CN103856552A (en) * 2012-11-29 2014-06-11 广州市千钧网络科技有限公司 Method and device for interactive live telecast
CN104244101A (en) * 2013-06-21 2014-12-24 三星电子(中国)研发中心 Method and device for commenting multimedia content
CN104243848A (en) * 2014-08-22 2014-12-24 苏州乐聚一堂电子科技有限公司 Virtual concert sound induction system
CN104731342A (en) * 2015-04-03 2015-06-24 山东大学 Inertial motion capture system capable of collecting and capturing face expression of object at the same time and operation method thereof
TWI494799B (en) * 2012-09-18 2015-08-01 Sintai Optical Shenzhen Co Ltd Multimedia device capable of receiving instructions via user's attitudes in three-dimensional space
CN105263040A (en) * 2015-10-08 2016-01-20 安徽理工大学 Method for watching ball game live broadcast in mobile phone flow saving mode
CN106254793A (en) * 2016-09-23 2016-12-21 北京赢点科技有限公司 Method based on outdoor television mobile control room real-time interactive and outdoor television mobile control room
CN106331818A (en) * 2016-09-27 2017-01-11 北京赢点科技有限公司 Cross-screen interaction method and system
CN106373142A (en) * 2016-12-07 2017-02-01 西安蒜泥电子科技有限责任公司 Virtual character on-site interaction performance system and method
CN107203263A (en) * 2017-04-11 2017-09-26 北京峰云视觉技术有限公司 A kind of virtual reality glasses system and image processing method
CN107750014A (en) * 2017-09-25 2018-03-02 迈吉客科技(北京)有限公司 One kind connects wheat live broadcasting method and system
CN108986190A (en) * 2018-06-21 2018-12-11 珠海金山网络游戏科技有限公司 A kind of method and system of the virtual newscaster based on human-like persona non-in three-dimensional animation
CN109660818A (en) * 2018-12-30 2019-04-19 广东彼雍德云教育科技有限公司 A kind of virtual interactive live broadcast system
CN109841196A (en) * 2018-12-24 2019-06-04 武汉西山艺创文化有限公司 A kind of virtual idol presentation system based on transparent liquid crystal display
CN112702611A (en) * 2019-10-22 2021-04-23 上海华为技术有限公司 Playing method and playing system
CN112752025A (en) * 2020-12-29 2021-05-04 珠海金山网络游戏科技有限公司 Lens switching method and device for virtual scene
CN114885147A (en) * 2022-07-12 2022-08-09 中央广播电视总台 Fusion production and broadcast system and method

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN201207693Y (en) * 2007-09-03 2009-03-11 上海广涌音像制作有限公司 Mobile phone multimedia innovation studio
CN101465957A (en) * 2008-12-30 2009-06-24 应旭峰 System for implementing remote control interaction in virtual three-dimensional scene
CN101674419A (en) * 2008-09-10 2010-03-17 新奥特(北京)视频技术有限公司 Method for editing template in real time in virtual studio system

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN201207693Y (en) * 2007-09-03 2009-03-11 上海广涌音像制作有限公司 Mobile phone multimedia innovation studio
CN101674419A (en) * 2008-09-10 2010-03-17 新奥特(北京)视频技术有限公司 Method for editing template in real time in virtual studio system
CN101465957A (en) * 2008-12-30 2009-06-24 应旭峰 System for implementing remote control interaction in virtual three-dimensional scene

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
朱登明,王兆其: "基于动作单元分析的人体动画合成方法研究", 《计算机研究与发展》, 31 December 2009 (2009-12-31) *
王兆其, 高 文: "基于虚拟人合成技术的中国手语合成方法", 《软 件 学 报》, 31 December 2002 (2002-12-31) *
王慧雅,许华虎,吴 佩,谢逸群: "与虚拟节目主持人对话场景的研究与实现", 《计 算 机 工 程》, vol. 34, no. 14, 31 July 2008 (2008-07-31) *

Cited By (23)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102685461A (en) * 2012-05-22 2012-09-19 深圳市环球数码创意科技有限公司 Method and system for realizing real-time audience interaction
TWI494799B (en) * 2012-09-18 2015-08-01 Sintai Optical Shenzhen Co Ltd Multimedia device capable of receiving instructions via user's attitudes in three-dimensional space
CN103856552A (en) * 2012-11-29 2014-06-11 广州市千钧网络科技有限公司 Method and device for interactive live telecast
CN103179437A (en) * 2013-03-15 2013-06-26 苏州跨界软件科技有限公司 System and method for recording and playing virtual character videos
CN104244101A (en) * 2013-06-21 2014-12-24 三星电子(中国)研发中心 Method and device for commenting multimedia content
CN104243848A (en) * 2014-08-22 2014-12-24 苏州乐聚一堂电子科技有限公司 Virtual concert sound induction system
CN104731342B (en) * 2015-04-03 2018-04-17 山东大学 It is a kind of to gather the inertia action seizure system and its operation method for catching subjects face expression at the same time
CN104731342A (en) * 2015-04-03 2015-06-24 山东大学 Inertial motion capture system capable of collecting and capturing face expression of object at the same time and operation method thereof
CN105263040A (en) * 2015-10-08 2016-01-20 安徽理工大学 Method for watching ball game live broadcast in mobile phone flow saving mode
CN106254793A (en) * 2016-09-23 2016-12-21 北京赢点科技有限公司 Method based on outdoor television mobile control room real-time interactive and outdoor television mobile control room
CN106331818A (en) * 2016-09-27 2017-01-11 北京赢点科技有限公司 Cross-screen interaction method and system
CN106373142A (en) * 2016-12-07 2017-02-01 西安蒜泥电子科技有限责任公司 Virtual character on-site interaction performance system and method
CN107203263A (en) * 2017-04-11 2017-09-26 北京峰云视觉技术有限公司 A kind of virtual reality glasses system and image processing method
CN107750014A (en) * 2017-09-25 2018-03-02 迈吉客科技(北京)有限公司 One kind connects wheat live broadcasting method and system
WO2019057194A1 (en) * 2017-09-25 2019-03-28 迈吉客科技(北京)有限公司 Linked microphone-based live streaming method and system
CN107750014B (en) * 2017-09-25 2020-10-16 迈吉客科技(北京)有限公司 Live wheat-connecting method and system
CN108986190A (en) * 2018-06-21 2018-12-11 珠海金山网络游戏科技有限公司 A kind of method and system of the virtual newscaster based on human-like persona non-in three-dimensional animation
CN109841196A (en) * 2018-12-24 2019-06-04 武汉西山艺创文化有限公司 A kind of virtual idol presentation system based on transparent liquid crystal display
CN109841196B (en) * 2018-12-24 2021-09-28 武汉西山艺创文化有限公司 Virtual idol broadcasting system based on transparent liquid crystal display
CN109660818A (en) * 2018-12-30 2019-04-19 广东彼雍德云教育科技有限公司 A kind of virtual interactive live broadcast system
CN112702611A (en) * 2019-10-22 2021-04-23 上海华为技术有限公司 Playing method and playing system
CN112752025A (en) * 2020-12-29 2021-05-04 珠海金山网络游戏科技有限公司 Lens switching method and device for virtual scene
CN114885147A (en) * 2022-07-12 2022-08-09 中央广播电视总台 Fusion production and broadcast system and method

Similar Documents

Publication Publication Date Title
CN102340690A (en) Interactive television program system and realization method
US9751015B2 (en) Augmented reality videogame broadcast programming
US10582182B2 (en) Video capture and rendering system control using multiple virtual cameras
US10650590B1 (en) Method and system for fully immersive virtual reality
US10121284B2 (en) Virtual camera control using motion control systems for augmented three dimensional reality
CN110060351B (en) RGBD camera-based dynamic three-dimensional character reconstruction and live broadcast method
CN109889855A (en) Intelligent panoramic video live broadcast network shopping system and method based on mobile APP
CN109195020A (en) A kind of the game live broadcasting method and system of AR enhancing
US8885022B2 (en) Virtual camera control using motion control systems for augmented reality
CN103051830A (en) System and method for multi-angle real-time rebroadcasting of shot targets
CN113382275B (en) Live broadcast data generation method and device, storage medium and electronic equipment
KR20150105058A (en) Mixed reality type virtual performance system using online
WO2009078909A1 (en) Virtual object rendering system and method
KR20190031220A (en) System and method for providing virtual reality content
CN113395527A (en) Remote live broadcast virtual background cloud synthesis system based on VR technology
JP4330494B2 (en) Broadcast program participation system and method
KR102568021B1 (en) Interactive broadcasting system and method for providing augmented reality broadcasting service
CN113992921A (en) Virtual reality live video communication new technology
US20250046000A1 (en) Advanced multimedia system for analysis and accurate emulation of live events
BG4776U1 (en) INTELLIGENT AUDIO-VISUAL CONTENT CREATION SYSTEM
Milovanovic et al. An overview of developments and standardization activities in immersive media
KR20250125215A (en) Method for providing a VR content relay platform and apparatus thereof
Yoshida et al. Displaying free-viewpoint video with user controlable head mounted display DEMO
GB2590749A (en) Method and system for interactive embedding of virtual 2D shapes and 3D forms in 360° live video stream
CN120434412A (en) A live broadcast real-time interactive system and method based on AR

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C02 Deemed withdrawal of patent application after publication (patent law 2001)
WD01 Invention patent application deemed withdrawn after publication

Application publication date: 20120201