JP2002538645A - Non-linear multimedia editing system integrated in television, set-top box, etc. - Google Patents

Abstract

(57) Abstract Non-linear media editors can be integrated into analog or digital television, digital set-top boxes, Internet devices, and the like. Editing system 100 includes an analog 116 or digital 142 camera or camcorder, an analog or digital satellite signal 102, an analog or digital cable signal 104, an analog or digital broadcast signal 106 received via an antenna, and a modem, ISDN, xDSL, cable. -It is configured to receive input signals from various input signals, including Internet signals 120 received via a modem 122 or the like. In some configurations, the system includes one or more transceivers 110, analog converters 308 and decoders 304, cable modems 310, decompressors 320, 322, processors 124, 324, codecs 210, 212, 224, and encoders. 140, 330 may be included. The editing system may include a single chip or chip set, media processor 130, memory 132, and storage 134, such as a hard disk drive. The editing system can be integrated on a set-top box circuit board, added to a television circuit, or added to an Internet device. The output signal includes video 330, audio 332 and data 334 and can be presented to a user on an analog 146 or digital 144 television, an analog or digital camera or camcorder, or other media recording device 148. The editing system includes a software program that obtains commands to execute editing operations using a graphical user interface (GUI) and receives commands from a user. The editing system edits the received input according to the received command, in which case the editing operation may include a fade in / out, a dissolve, a wipe, or a video effect.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

TECHNICAL FIELD OF THE INVENTION

The present invention relates to non-linear multimedia editing. More particularly, the invention relates to the integration of non-linear multimedia editors into televisions, set-top boxes, Internet devices, and the like.

[0002]

[Prior art]

As reported in the Emerging Technology Report, EE Times, April 1996, there are approximately 140 million camcorders worldwide. Dataquest,
According to September 1996, about 12 million new camcorders are sold each year. The average camcorder owner shoots special events, such as birthdays, holidays, and sporting events, as well as other milestones of life, to share with friends and family and to communicate to their offspring. Despite the various activities that take place at the consumer level about videotaping, users can edit this video electronically and distribute it as a memorabilia or on the spot (or within hours of the filming). 2) There are no attractive products that allow you to share with friends and family. As an example of this “sharing” of multimedia information, a young family may be
There is an example of capturing a video clip of ~ 20 seconds, editing it and sending it by email to the child's grandparents.

[0003] Digital video editing on computer workstations or personal computers has evolved into a common practice for professionals creating movie, television, video game, educational and marketing video content. Manufacturers of these products have sought to expand their product line to consumers by selling additional hardware and software for personal computers.

[0004] The problem with expanding the product line is that users must either own their own computers or have to buy them. Once a user purchases a product, he must purchase the necessary hardware and software add-on components for editing. Consumers must also ensure that their personal computers have sufficient memory and hard drives to support video data rates.

[0005] Consumer surveys have shown that consumers typically do not add components, especially built-in hardware components, to their personal computers (PCs),
Even if consumers proceed with the above procedure, PCs are not ideal products. The reasons PCs are inadequate products for home video editing and communication are that the location of the PC is usually not close enough to the television connected to the VCR, e-mailing heavy data video Lack of bandwidth to do and its cost.

[0006] The demand for PCs, the long distance to the VCR for PC owners, and the complexity of video editing systems are responsible for the lack of products in this area for consumers. Griffin Di
According to x Reserach, 17 million Americans are believed to have computers and video cameras. On average, each of these American households has about 20 unedited videotapes (raw tapes). These households do not want to spend thousands of dollars upgrading their computers and incorporating video editing systems.

[0007] Close to VCR is important because the user not only wants to edit a new videotape shot with his camcorder, but also wants to edit a video already shot on a VHS tape. Finally, once the videotape has been edited, the user must record and save the edited videotape on a VHS tape. Therefore, the user must connect the VCR to the PC even when performing any basic editing steps.

[0008]

[Problems to be solved by the invention]

One of the main purposes of filming videotapes is to share experiences with friends and family. Families can be reached today in various ways, such as by phone, telegram, mail, or email.

[0009] The image quality of videophones that are becoming widespread is still low, but a function of seeing the face of a conversation partner has been added. Videophone does not address the problem of showing a passive event that occurred where the videophone camera could not shoot, or that occurred at any time other than during a phone call.

[0010] Video tapes allow users to share their experiences, but unless the tapes are first edited and compressed, they cannot withstand viewing and cannot be transmitted electronically.

[0011]

[Means for Solving the Problems]

One aspect of the invention includes a television receiver that includes a digital non-linear media editor, the receiver configured to receive at least one media signal, and to receive the media signal. A media editor configured to enable an editing operation on at least one media signal and provide an edited output signal, and a codec receiving the edited output signal and generating a video output signal based thereon. Including.

[0012] Another aspect of the invention includes a television system including a digital nonlinear media editor, wherein the system is configured to receive a video signal and to digitize the video signal. A media editor configured to perform data communication with a video input circuit, receive a digitized video signal, and operate at least one of the received signals; and receive an output signal of the media editor. A video encoder for generating an analog video output signal.

Another aspect of the invention includes a system including a non-linear editor, wherein the system is configured to receive audio and video signals and to digitize the audio and video signals. A transceiver configured to receive at least one multimedia signal and demodulate the multimedia signal; and connected to the transceiver to receive and decompress the demodulated multimedia signal. A configured decompression device, connected to the audio / video input circuit and the decompression device, and configured to receive the digitized audio and video signals and the decompressed multimedia signal; And a media editor that can operate one.

[0014] Yet another aspect of the invention includes a digital television system including a non-linear media editor, wherein the system receives audio and video signals and digitizes the audio and video signals. A configured audio / video input circuit, a transceiver configured to receive at least one multimedia signal and demodulate the multimedia signal, and a demodulated multimedia signal connected to the transceiver and receiving the demodulated multimedia signal. A decompression device configured to receive and decompress, and coupled to the audio / video input circuit and the decompression device to receive digitized audio and video signals and decompressed multimedia signals. And a media editor configured to edit at least one of the received signals.

[0015] Yet another aspect of the invention includes a system including a non-linear editor, wherein the system is configured to receive audio and video signals and to digitize the audio and video signals. A circuit, a network interface circuit configured to receive at least one media signal, and a central processing unit (CPU) configured to perform data communication with the network interface circuit and receive the media signal. And the audio / video input circuit and CPU
And a media editor configured to receive the digitized audio and video signals and the media signals in data communication therewith and capable of editing and operating at least one of the received signals.

[0016] Yet another aspect of the invention includes a system including a non-linear editor, the system configured to receive at least one media signal, and a connection to the network interface circuit. And
A central processing unit (CPU) configured to receive a media signal; a cable modem configured to receive at least one multimedia signal and demodulate the multimedia signal; A decompression device connected and configured to receive and decompress the demodulated multimedia signal; and a CPU and a decompression device connected to the decompression device for receiving the media signal and the decompressed multimedia signal. And a media editor configured to edit at least one of the received signals.

[0017]

BEST MODE FOR CARRYING OUT THE INVENTION

The following detailed description of the preferred embodiments describes specific embodiments of the invention. However, the invention can be embodied in many different ways as defined in the claims. In the description that follows, like parts are consistently designated with like numerals when referring to the drawings.

The world's first digital television broadcast (DTV and HDTV) is 1998
Started in the United States on November 1, 2013. Digital television is set-top
Boxes are available, act as receivers, and support a number of other feature sets such as email, web browsing, and video on demand, to name a few. These set-top boxes will include both a hard drive and a cable modem for broadband e-mail and Internet connectivity. Future digital televisions may incorporate the set-top box or components of the set-top box into the television housing.

The present invention provides a sub-system that allows a user to digitize, edit and communicate multimedia information via digital or analog television having a set-top box or components of a set-top box. About the system. One embodiment of the invention consists of a single chip or chip set and a software product designed within the motherboard of the set-top box.

Another digital non-linear editing system is a pure software product that works with a video capture device or the hardware is a video capture and editing PCI (periphera
l component interconnect) It is a product that combines hardware / software consisting of additional boards. The latter system will also incorporate audio boards for audio capture, mixing and editing. In each case, the devices communicate via drivers that interface with the computer's operating system.

[0021] A typical system uses a small Quick Time ^(R) or Act in the RGB color space.
Use a non-interlaced computer monitor for a graphical user interface (GUI) that can preview the contents in the ive Movie ^(R) window. The final video is all video formats (RF, composite video, S video (Y / C)
Using a YUV color space or its equivalent Chroma and Luma separation color space, which is displayed on a display environment such as a television set or video monitor located beside a computer monitor.

There are several drawbacks to how these systems are designed, which makes them inadequate products for television or set-top box environments. First, such systems rely on a computer monitor to display a GUI. Computers operate in the RGB color space, while video displays or recorders operate in the YUV color space or a similar space such as YIQ, YIC, or YCrCb. A second major obstacle to incorporating a computer's nonlinear editing system into a television or digital set-top box is cost.

These devices are consumer devices; any add-on functionality must be cost-effective. Incorporating an optional add-on function into a consumer electronic device to accommodate distribution and sales channels usually results in an increase in retail sales that is four to five times the cost of that function. Today's non-linear editing hardware systems are manufactured on PCI add-on boards, and it is not physically or cost-effective to incorporate those PCI add-on boards into a television or digital set-top box. is there.

Although digital television or set-top boxes are expected to incorporate hard drives in the future, low cost hard drives such as 5
400rpm EIDE drive or 7200rpm or 1000rpm SC
SI hard drives are most desirable.

A large number of functions of computer-based video editing systems, such as video mixing and layering, reside in software. As a result, a way to improve performance is to increase the processing power of the system's microprocessor, ie, to add more sophisticated processors or multiple processors, or to add video data streams and mixing ICs to speed up video mixing. (Integrated circuit).

Adding a video data stream requires a second compression IC and a second hard drive or A / V class hard drive to support both streams. Again, television or digital set-top
Not only is cost a major concern for consumer electronic devices such as boxes, but the physical space within these devices is also very limited. Adding additional components to increase performance increases costs even if there is room to accommodate such additional components.

After all, computer-based editing systems rely on large-scale software programming, which requires a large amount of hard drive disk space to accommodate application programs. For example, popular computer-based applications, such as Adobe Premiere, use 32 MB of RAM and 60 MB of hard disk space as minimum system requirements.
miere 5.0 User Guide, 1998). Memory is valuable in digital television and set-top boxes.

The present invention overcomes the limitations of existing nonlinear editing systems for consumer use.
The invention relates to television (analog or digital) or set-top
It is designed to integrate with the best platform for video input and output on the Internet that can be embodied in a box. Some manufacturers make editing systems with software and off-the-shelf components integrated into PCI add-on boards for computers.

The present invention may include an editing chip mounting system or a reduced chip set for real-time video editing, either of which can be used as a multimedia processor (MP). In one embodiment, the MP has its own built-in processor and represents an audio / video mixing and graphics effects engine. Also M
P typically incorporates software resident functionality in other editing systems.
Therefore, the MP is considered a multimedia or media editor and can also be called a media editor section. As a result, high performance as defined by real-time editing, transitions and 2D effects is achieved without the need for high speed or multiple microprocessors and without the need for sophisticated hard drives.

For example, a three-quarter inch system chip product overcomes the limitations and cost issues of these consumer products. These perfect products are relatively cheap. Retail prices for comparable PC-based products are sold separately from computers,
That is, a video board, audio board, and software alone cost $ 2,500 to $ 1
$ 0000. Popular consumer PC-based editing products retail for only $ 200-1000 separately from computers.

Further, by using a multimedia processor to limit the requirements of the operating system and applications to those of video editing rather than a general computer system, the editing application of the present invention can be used in a computer-based editing system. Can be much smaller than Software applications for the present invention that use about 900 KB of memory reside in read-only memory (ROM) on the MP and therefore do not require hard drive space. Should the hard drive crash, the application will continue to run,
Prompts the user to replace the failed drive. There is no so-called system crash.

In one embodiment, the MP-implemented processor is a slave processor to the television or set-top box processor for all functions except editing, but becomes a master processor in the case of editing. This architecture allows for a variety of set-top boxes regardless of the specific processor.
P can be incorporated.

Finally, systems that include a GUI can operate completely in the YUV color space, which is ideal when using a video device for display or tape storage. The user uses the GUI to reduce the video content (eg, in the upper right corner of the display) while using the system functions, and to display the final image in high quality, a full screen preview of that image. Switching to display is possible.

A unique feature included in the GUI is that the user does not need to prepare a second monitor using the display environment, ie, the television screen as a working space and a preview space. In sum, the present invention focuses on the consumer / living room environment and includes a cost-effective software-based chipset product that can be easily integrated into a variety of television or digital set-top boxes.

Referring to FIG. 1, an exemplary top-level block diagram of a set-top box 100 designed for editing video, audio, and Internet content will be described. The external audio / video (A / V) source 116 (baseband)
For example, it may be a VCR, laser disk player, DVD player, or other baseband video source at home.

[0036] Support for existing home entertainment analog inputs is a conventional set-top box generally limited to the purpose of translating digital content (satellite or web) for display on an analog television display. Not provided in configuration. The signals for the interface are, for example, a composite video, a Y / C video (S video), and a stereo audio signal.

The A / V input circuit 118 includes, for example, a circuit for receiving, buffering, amplifying, and digitizing incoming video and audio. The A / V input circuit is CCIR6
01 digital video and digital audio formats are output on a signal line 119. Of course, other formats and standards such as CCIR656 can be used. By digitizing the video and audio in circuit 118, the system allows all source material (such as analog VCR 116 or source material from satellite antenna 102) to be converted into a single common source required for mixing and editing by multimedia processor 130. Can be handled in format.

The transmission / reception unit 110 can achieve down conversion, demodulation, synchronization extraction, forward error correction, and decryption as necessary. The transmitting / receiving unit 110 includes a receiving unit 112
And a transmission unit 114. The decompression block is used for the data stream received by the receiver 112 that has been compressed at the source and must be decompressed in the same way at the set-top box. The uncompressed input is
Converted to one common mixing format used consistently in the system.

The data stream that is not compressed at the transmission source bypasses the decompression operation and passes through the multimedia processor 130 via signal line 129 in the audio and video signal path.
Is forwarded to The multimedia processor 130 is provided in one embodiment as a custom chip mounting system (SOC) device.

The A / V output circuit 140 processes the output signal of the multimedia processor 130 to process the analog television 146 or VCR 148, or the digital
It drives an output device such as a television (DTV) 144, camera 142, or other digital recording device. The addition of a hard disk drive 134 to the model of the set-top box via the control of the media processor allows for high-performance storage and recall of media (for editing, reproduction and recording purposes) with a CPU. Time consumption by the bus 125 and the CPU 124 itself is prevented.

Main component storage device 134, memory 132, multimedia processor 13
0, and input circuit 118 is a novel feature that transforms a passive display-only set-top box (eg, web browser, satellite receiver) into a digital editing device.

Hereinafter, specific components of FIG. 1 will be further described.

Transmission / Reception Unit 110 (Reception Unit 112 and Transmission Unit 114) The transmission / reception unit 110 includes the reception unit 112 and the transmission unit 114, and includes all of the tuner, the modulation device and the demodulation device, the FEC, and the transport processor in one block. To have. This tuner can take an antenna or cable signal as input. The set-top box can also receive unbroadcasted signals as input.

The cable interface is shown as bidirectional and connects the set-top box to the Internet or other communication network. Video can be created using a set-top box system and formatted for bandwidth efficient transmission over the Internet. Cable tuners are now widely available. The Yankee Group estimates that home network space sales will reach $ 1 billion by 2002.

The output of the data demodulator is a serial digital data stream. F
EC, Transport Processor and Access Control: The input to the FEC is a potentially erroneous digital data stream. The output of the FEC is an error corrected data stream.

If the data stream has uncorrectable errors, the FEC provides a signal indicating which data block is erroneous so that some error concealment algorithms can be used. The input to the transport processor block is an error correction data stream. This block analyzes various multiplexed data (video, audio and data) for further processing. This block also has internal access control elements for data decryption.

Internet Interface Circuit 122 Internet interface circuit 122 can support Ethernet, plain old telephone service (POTS), xDSL, ISDN via modem, cable modem or other suitable interface circuit. . It can use and support a variety of interface standards.

Multimedia or Media Processor (MP) 130 Applied Magic is a Gr that acts as a multimedia or media processor (MP) for the current generation of non-linear multimedia editing systems (Screen Play).
Has a chip called imoire. For an improved version of the Grimoire chip, see Figure 2 “
Block diagram of multimedia processor ".

Various formats for digital media signals can be used. In one embodiment, the MP uses CCIR-656 format signals. Other embodiments can use signals in other formats, such as CCIR-601. In one embodiment, an SDRAM memory is connected to the MP. This memory may be 32 MB to 128 MB of memory available from Hitachi, Hyundai, and other vendors.

Storage Device 134 The storage device 134 represents a general-purpose storage device such as an EIDE (U-ATA) type hard disk drive (HDD). Other potential options may include any mass storage device capable of sustained data rates of up to 3 megabytes / second. Optical storage is an option as data rates increase.

DV Physical Layer and Link Layer Circuit 138 The DV physical layer and link layer circuit 138
/ IEEE1394 interface. Circuit 138 illustrates an optional DV / 1394 interface for multimedia processor 130.

In one embodiment, optional DV codec hardware 2
24, and a link layer and physical layer (PHY) circuit 138 is required externally to complete the interface. For example, with a faster system CPU 124 above 200 MHz, the codec can be executed in software.
In that case, the DV link layer and the PHY circuit 138 are connected to the local CPU bus 125.
Connected to. Exemplary components include a physical layer chip TSB41LV03PFP from Texas Instruments (TI) and a link layer chip TSB12 from TI.
LV42PZ.

The multimedia processor (MP) 130 will be further described with reference to FIG. At the heart of multimedia processor 130 is the pending patent application “Non-Linear Editing System for Home Entertainment Environments”
US application Ser. No. 08 / 906,589, filed Aug. 5, 1997, entitled
An advanced multimedia processing engine 200 described in U.S. Application No. 08 / 906,304, filed August 5, entitled "Media Editor for Non-Linear Editing System".

The engine 200 performs real-time mixing of all of the multiple channels of video and audio, and performs operations such as fade in / out, dissolve, wipe, title creation, graphics synthesis or video effects. To enhance this existing engine as part of the multimedia processor 130, support has been added for internally compressed video material via a codec 210 and an optional second codec 212.

Also, storage via hard disk controller 220 on drive 134 allows multimedia processor 130 to operate with little intervention from CPU 124 and with little load on bus 125. Device support has also been added. This is crucial for real-time video / audio editing within a set-top box design.

In order to maintain high processing power in multimedia processor 130 without the intervention of main CPU 124, DMA controller 218 provides compression between memory 132 and all the internal components of the multimedia processor. And uncompressed media
Handles all movement of data. In one embodiment, all edits, DMAs, effects,
The store, play, title and mixing operations are set and controlled by register set 222.

The setting of these registers is the minimum level of intervention required by the host CPU 124. This is a major problem for the development of set-top boxes, while conventional video editing techniques require high processing power, whereas the host CPU 124 can have low processing power and thus low cost. It means there is.

The multimedia processor 130 can include a digital video (DV) codec core 224 that supports DV IEEE 1394 digital video devices commonly used in consumer camcorders and other digital devices. By adding a DV codec 224, this decompression stage is
It comes off from the load of 4. The DV signal can be input from the digital camera 142 to the media processor 130 via the signal line 141, the DV circuit 138 and the signal line 119.

The MP is, for example, a chip mounting system (SOC) or chip set incorporating an advanced multimedia processing engine such as the Grimoire ASIC and other circuits. The specific components of FIG. 2 are described in more detail below.

Video Compression / Decompression Core 210 The video compression / decompression (codec) core 210 represents a general purpose method for video compression and decompression consisting of an engine and some memory. In one embodiment, wavelet compression is used, but other embodiments may use other compression methods that maximize efficiency while minimizing the number of gates. FIG. 2 shows two compressed blocks. In one embodiment of the MP, the second compression / decompression core 212
Is optional. The second core block 212 is capable of dual stream real-time (60 fields / sec) effects and transitions.

Advanced Multimedia Processing Engine 200 The advanced multimedia processing engine 200 represents a video and audio mixing engine, such as the Grimoire ASIC, that enables single stream real-time effects and transitions. With an optional second compression core 212, dual stream real-time effects and transitions are achieved. This engine 200 requires an external SDRAM 132 to perform its function.

Host CPU Interface 216 The host CPU interface 216 indicates the logic on this SOC 130 that interfaces to the main system CPU 124. In one embodiment, the main system CPU1
24 is an IBM model 403 GCX-66 PowerPC, but in other embodiments other system CPUs may be used depending on various factors such as performance price and availability.

DMA Controller 218 The DMA controller 218 illustrates the logic on this SOC 130 that assists in managing the burst data transfer needed to achieve maximum utilization of the available system bandwidth.

HDD Interface Controller 220 The HDD interface controller 220 has a local processor bus and an EID
Represents the control logic required to support high data rate transfers to and from hard disk drives, such as using the E format. The EIDE format is fast and cost effective. Other high speed, cost effective formats are also contemplated and can be used in alternative embodiments.

Control and Status Register 222 The control and status register 222 represents a new writable control register and a readable status register in the multimedia processor. Exemplary registers include registers that enable advanced features related to the Chroma key.

Digital Video (DV) Codec 224 (Optional) An exemplary DV codec is NW701 from Divio. FIG. 3 shows a detailed and / or modified view of the block diagram of the top-level system of FIG. The system 300 shown in FIG. 3 provides many of the same set-top box functions of the system 100 shown in FIG. 1, except that the cable signal (analog or digital) 104 and the cable modem 310 are different from the conventional set-top box. It is the basic source of functions (television viewing and web browsing).

Passive by additional components such as video input buffer and multiplexer 302, video decoder 304, multimedia processor 130, memory 132, storage 134, audio input buffer 306, and audio analog to digital converter 308. A classic set-top box turns into a real-time editing system.

Using the data paths 341 and 343 as an editing system, the edited media content is transmitted over the cable modem 310 and the cable 104 to the Internet, allowing access from around the world. Thus, in addition to this set-top box being able to create edited media for the delivery of television or videotape, the same content is
It is compressed into a media format compatible with the Internet by the processor 130 or the CPU 124 and delivered to the Web (WWW).

Hereinafter, specific components of FIG. 3 will be described in detail.

Analog Inputs 302, 204, 306, 308 Four blocks 302, 304, 306, 308 represent video and audio analog inputs. This allows video and / or audio to be imported from devices commonly used in the home, such as VCRs, camcorders, and the like.

Cable Modem 310 Cable modem 310 is shown as a two-way cable modem. Its purpose is to provide high-speed digital communication between the set-top box and the outside world. Cable modems are well known and can be purchased from many vendors.
The cable modem includes three parts:

A) Modem which is a cable tuner and a data demodulator. The input to the tuner is a radio frequency (RF) signal. The output to the demodulator is a serial digital data stream.

B) Forward error correction (FEC) unit. The input to the FEC is a potentially erroneous digital data stream. The output of the FEC is an error corrected data stream. If the data stream has an uncorrectable error, the FEC provides a signal indicating which data block is in error,
Certain error concealment algorithms can be used.

C) Transport processor with access control. The input to this part is an error correction data stream. This part analyzes various multiplexed data (video, audio and data) for the next processing. This block also has internal access control elements for data decryption.

Video Decompression Processor 320 This block is the MPEG Video Decompression Processor 320. This block is intended to represent an industry standard technology for this function. Illustrative components are DV Express and General Instrument from C-cube.
AVI made by t.

Audio Decompression Processor 322 The audio decompression processor 322 can use AC / 3, MUSICAM, or other audio compression (decompression) standards. Exemplary components are IBM MPEG
/ AC3 core and Zoran AC3 chip.

Data Channel Processor 324 All digital satellite and cable systems have auxiliary data channels.
Data channel processor 324 represents a means for processing and using the data of the auxiliary data channel.

Video Encoding Device 330 In one embodiment, the video encoding device 330 inputs CCIR-656 video and converts it to analog format. The video encoding device 330 uses the composite and Y /
Has C output. The components of the exemplary video encoding device are AD devices from Analog Devices.
V7176.

Audio DAC and Volume Control 332 The audio DAC and volume control 332 receives digital audio from a multimedia processor and converts it to an appropriate level of analog. An exemplary component is AKM4531.

Data Interface Circuit 334 Data interface circuit 334 is a USB, RS-422 or some other standard data interface circuit. USB has the advantage of being bidirectional, whereas RS-422 is unidirectional (output only).

Features and Benefits System chip products eliminate the need for PCI slots that are not found in televisions or set-top boxes and cannot be integrated in a cost-effective manner.

• System Chip Technology-All benefits are provided by the following two pending patent pending media editors: They are called "Non-Linear Editing Syste
No. 08 / 906,589, filed Aug. 5, 1997 and entitled "Media Editor for Non-Linear Edit," entitled "m for Home Entertainment Environments."
No. 08/90630, filed August 5, 1997, entitled "ing System".
No. 4. These are both incorporated herein by reference.

Dedicated video editing techniques have low demands on memory—both in use and storage (
For example, 900K full size versus 30MB and more for computer based systems). Unique form factor-Since all existing digital nonlinear editing systems are built around personal computers, integration into a television or digital set-top box is unique. is there.

The media editor can be combined with a set-top box cable modem. Media editor can be combined with cable television feed.

The media editor can be combined with a broadcast digital television tuner.

The media editor can be combined with a broadcast television tuner.

The media editor can be combined with satellite (analog or digital) feeds.

The media editor can be combined with Internet or network feeds.

The media editor can be combined with the IEEE 1394 physical layer and the link layer for IEEE 1394 input / output transmission.

Performance Benefits The media editor allows for real-time transitions and 2-D effects without the need for a second video data stream and codec. A second hard drive or A / V (video-
It does not require a (voice) grade hard drive and allows real-time transitions and 2-D effects. Media editor allows real-time transitions and 2-D effects without the need for sophisticated microprocessors. The system is 66MH
z PowerPC processor but dual 400M if not in accordance with the invention
Hz or higher, use a Pentium (or equivalent) processor. Small application / OS profile (900K file size) and small physical size (Media Editor ASIC) enable cost-effective integration into consumer devices such as set-top boxes.

The present invention can be integrated into a personal video recorder, such as a personal video recorder provided by Tivo, Replay, etc. The present invention can also be realized by integration with an interface for Internet such as used in WebTV.

The specific blocks, parts, and devices have been described above. However, it will be apparent to those skilled in the art that there are many ways to delimit the system of the present invention, and there are many parts or components that can be substituted for the components or components described above.

While the above detailed description illustrates, describes, and points to basic new features that may be applied to various embodiments, those skilled in the art will recognize and describe them without departing from the spirit of the invention. Various forms and details of the system may be omitted, substituted, and modified.

[Brief description of the drawings]

FIG. 1 is a block diagram of one embodiment of a digital editing set-top Internet device of the present invention.

FIG. 2 is a block diagram of the multimedia processor shown in FIG. 1;

FIG. 3 is a block diagram of one embodiment of a set-top system showing components added to an existing set-top box architecture.

[Explanation of symbols]

 REFERENCE SIGNS LIST 100 editing system 102 satellite antenna 104 cable 106 antenna (for broadcasting) 110 transmitting / receiving section 112 receiving section 114 transmitting section 116 external analog source 118 analog video and audio input section 120 internet 122 internet interface circuit 124 system CPU 132 memory 130 media processor 134 Hard Disk Drive 137 Multimedia Processor 138 DV Physical and Link Layer Circuit 140 Analog Video and Audio Output Circuit 142 Digital Camera 144 Digital TV 146 Analog TV 148 Media Recording Device 200 Advanced Multimedia Processing Engine 210 Video Compression / Decompression core 212 Second optical codec 216 Host CPU interface 218 D A controller 222 Control and status register 224 Optional DV codec 220 HDD interface controller 302 Analog input buffer and multiplexer 304 Decoder 306 Analog input buffer 308 Audio ADC 310 Cable modem 320 Video decompression processor 322 Audio decompression processor 324 data channel processor 330 video encoder 332 audio DAC and volume controller 334 data interface circuit

──────────────────────────────────────────────────続 き Continued on the front page (51) Int.Cl. ⁷ Identification symbol FI Theme coat ゛ (Reference) H04N 7/14 H04N 5/92 H // H04N 5/262 5/781 510F (81) Designated country EP (AT) , BE, CH, CY, DE, DK, ES, FI, FR, GB, GR, IE, IT, LU, MC, NL, PT, SE), OA (BF, BJ, CF, CG, CI, CM) , GA, GN, GW, ML, MR, NE, SN, TD, TG), AP (GH, GM, KE, LS, MW, SD, SL, SZ, TZ, UG, ZW), EA (AM, AZ, BY, KG, KZ, MD, RU, TJ, TM), AE, AL, AM, AT, AU, AZ, BA, BB, BG, BR, BY, CA, CH, CN, C , CU, CZ, DE, DK, DM, EE, ES, FI, GB, GD, GE, GH, GM, HR, HU, ID, IL, IN, IS, JP, KE, KG, KP, KR, K Z, LC, LK, LR, LS, LT, LU, LV, MA, MD, MG, MK, MN, MW, MX, NO, NZ, PL, PT, RO, RU, SD, SE, SG, SI, SK, SL, TJ, TM, TR, TT, TZ, UA, UG, UZ, VN, YU, ZA, ZW (72) Inventor Shafa Jeffrey V. United States 92054 California Oceanside Main Sail Road 373 F-Term (Reference) 5C023 AA12 AA13 AA18 AA26 AA32 AA34 AA37 AA38 BA11 CA03 CA04 CA05 DA04 DA08 5C025 AA25 AA28 AA29 BA27 BA28 BA30 CA09 CB10 DA01 FA04 FA05 FA10 FA27 FA29 GB11 GB22 JA07 JA16 KA04 KA24 LA01 LA07 LA11 LA15 5C064 AA06 AC04 AC06 AC18 AC20 AD02 AD06 AD14 The editing system can be integrated on a set-top box circuit board, added to a television circuit, or added to an Internet device. The output signal includes video 330, audio 332 and data 334 and can be presented to the user on an analog 146 or digital 144 television, an analog or digital camera or camcorder, or other media recording device 148. The editing system includes a software program that uses a graphical user interface (GUI) to obtain commands for performing editing operations and receives commands from a user. The editing system edits the received input according to the received command, in which case the editing operation can include a fade in / out, dissolve, wipe, or video effect.

Claims (56)

[Claims] 1. A television receiver including a digital non-linear media editor, the receiver configured to receive at least one media signal, and to receive a media signal. A media editor configured to enable an editing operation on at least one media signal and provide an edited output signal; and a codec receiving the edited output signal and generating a video output signal based thereon. Television receiver including. 2. The image receiving apparatus according to claim 1, further comprising a transmitting section capable of transmitting a digital signal, and further comprising a transmitting section operably connected to the media editor. 3. The image receiving apparatus according to claim 2, wherein the receiving section and the transmitting section are integrated into the transmitting / receiving section. 4. The receiver according to claim 1, further comprising a television display for displaying at least a video output signal. 5. The receiver of claim 1, wherein the at least one media signal comprises an Internet signal. 6. The receiver of claim 1, wherein the at least one media signal comprises a digital television signal. 7. The receiver of claim 6, wherein the digital television signal is received by a satellite antenna. 8. The receiver according to claim 6, wherein the digital television signal is received by an antenna. 9. The image receiving device according to claim 1, wherein the receiving unit includes a tuner. 10. The receiver according to claim 3, wherein the transmission / reception unit includes a modem. 11. The receiver according to claim 3, wherein the transmission / reception unit includes a forward error correction circuit and a transport processor. 12. The image receiving apparatus according to claim 1, further comprising a decompression device receivably connected to a digital signal output of a receiving unit for decompressing at least a video portion of the digital signal. 13. The receiver of claim 12, wherein the decompressor decompresses the audio portion of the digital signal. 14. The receiver according to claim 1, wherein the codec generates an audio output signal. 15. The receiver according to claim 1, wherein the editing operation includes a fade-in / out, a dissolve, a wipe, a moving image effect, a title creation, or a graphics composition. 16. The receiver of claim 1, further comprising an analog output circuit and an analog television section, wherein the analog output circuit receives an edited output signal of the media editor. 17. The receiver according to claim 1, wherein the at least one media signal comprises an analog signal or a digital signal. 18. The receiver of claim 1, wherein at least one media signal represents a still image or video. 19. A television comprising a digital non-linear media editor.
A video input circuit configured to receive a video signal and digitize the video signal; and a digitized video signal in data communication with the video input circuit. And a video editor configured to receive at least one of the received signals, and a video encoder receiving an output signal of the media editor and generating an analog video output signal. . 20. The set-top box of claim 19, further comprising a television displaying at least one analog video output signal. 21. A method according to claim 21, wherein at least one operation of the received signal is fade-in / out
20. The set-top box of claim 19, wherein the set-top box includes editing operations such as dissolves, wipes, video effects, graphics compositing, or title creation. 22. A system including a non-linear editor, the system comprising: an audio / video input circuit configured to receive audio and video signals and digitize the audio and video signals; A transceiver configured to receive one multimedia signal and demodulate the multimedia signal; and a compression coupled to the transceiver and configured to receive and decompress the demodulated multimedia signal. A decompression device, connected to the audio / video input circuit and the decompression device, configured to receive digitized audio and video signals and decompressed multimedia signals, and operating at least one of the received signals A system that includes a capable media editor. 23. The system of claim 22, further comprising a memory connected to the media editor. 24. The system of claim 23, wherein the memory stores video frames for editing by a media editor. 25. The system of claim 22, further comprising a mass storage device connected to the media editor by a local bus, a decompression device, and a transceiver. 26. A video encoding device for receiving an output signal of a media editor, said video encoding device generating an analog video output signal.
System. 27. The system according to claim 26, further comprising a display device for displaying an analog video output signal. 28. The system according to claim 27, wherein the display device comprises an analog television set. 29. The system of claim 27, wherein the media editor obtains commands to perform editing operations using a graphical user interface (GUI). 30. The system according to claim 29, wherein the display device displays both the analog output signal and the GUI simultaneously. 31. The system of claim 22, wherein the media editor includes a software program for receiving commands from a user, and wherein the media editor edits received input according to the received commands. 32. The system of claim 22, further comprising a codec for receiving a media editor output signal, wherein the codec generates an encoded output signal. 33. The system of claim 32, further comprising digital television for playback of the encoded output signal. 34. The system of claim 22, wherein the editing operation includes a fade in / out, a dissolve, a wipe, a video effect, a graphics composition, or a title creation. 35. A digital television system including a non-linear media editor, said digital television system receiving audio and video signals and digitizing said audio and video signals. A configured audio / video input circuit, a transceiver configured to receive at least one multimedia signal and demodulate the multimedia signal, and a demodulated multimedia signal connected to the transceiver. A decompression device configured to receive and decompress; and connected to the audio / video input circuit and the decompression device, for receiving digitized audio and video signals and decompressed multimedia signals. And a media editor configured to edit at least one of the received signals. Stem. 36. The system of claim 35, further comprising a codec that receives the output signal of the media editor and generates a compressed output signal. 37. The system of claim 36, further comprising an output device for reproducing the compressed output signal. 38. The system according to claim 37, wherein the output device includes a display device and a sound reproducing device. 39. The system of claim 38, wherein the media editor obtains commands to perform editing operations using a graphical user interface (GUI). 40. The system according to claim 39, wherein the display device displays both the compressed output signal and the GUI simultaneously. 41. The system of claim 35, wherein the media editor includes a software program for receiving commands from the user, and wherein the media editor edits the received input signal according to the received commands. 42. The system of claim 35, wherein the editing operation includes a fade in / out, a dissolve, a wipe, a video effect, a title creation, or a graphics composition. 43. A system including a non-linear editor, the system comprising: an audio / video input circuit configured to receive audio and video signals and digitize the audio and video signals; A network interface circuit configured to receive one media signal; a central processing unit (CPU) configured to perform data communication with the network interface circuit and receive the media signal; And a media editor configured to receive the digitized audio and video signals and the media signal in data communication with the input circuit and the CPU and to edit at least one of the received signals. 44. The system of claim 43, further comprising a mass storage device in data communication with the media editor. 45. A video encoding device for receiving a media editor output signal, said video encoding device generating an analog video output signal.
System. 46. The system according to claim 45, further comprising a display device for displaying the analog video output signal. 47. The display device includes a television set.
System. 48. The system of claim 46, wherein the media editor obtains commands to perform editing operations using a graphical user interface (GUI). 49. The system according to claim 48, wherein the display device displays both the analog output signal and the GUI simultaneously. 50. The system of claim 43, wherein the media editor includes a software program for receiving a command from a user, and wherein the media editor edits the received input signal according to the received command. 51. The system of claim 43, further comprising a digital video module for receiving a media editor output signal, said digital video module generating a digital video format output signal. 52. The system of claim 51, further comprising a digital display device for reproducing an output signal in a digital video format. 53. The system of claim 43, wherein the editing operation includes a fade in / out, dissolve, wipe, or motion effect. 54. The system according to claim 43, wherein the media signal comprises a digital video signal. 55. A set-top box system including a non-linear editor, the set-top box system comprising: a network interface circuit configured to receive at least one media signal; A central processing unit (CPU) connected to the interface circuit and configured to receive the media signal; and a cable modem configured to receive at least one multimedia signal and demodulate the multimedia signal. A decompression device connected to the cable modem and configured to receive and decompress the demodulated multimedia signal; and a media signal and decompressed multimedia connected to the CPU and the decompression device. A media signal. Set-top box system that includes a media editor at least one possible editing operations. 56. The system according to claim 55, wherein the media signal comprises a digital video signal.