Compressor fails to work after exporting from FCP

Question

Level 1

1 points

Compressor fails to work after exporting from FCP

I am new to FCP/mac, and have been fighting with exporting from FCP to compressor. I talked with Apple Care, and they say the problem I'm having is with the captured video from my Sony DCR-TRV30 camera, and not a problem with Final Cut Studio 2. They say the TRV30 camera is not on the qualified list of devices, and produces "unqualified" video. I don't know enough to know if this is true, but a number of the things discussed with Apple didn't seem to "hold together". If the captured video prevents the compressor from progressing (e.g., keeps trying to process), why am I not able to successfully tell the Batch Monitor to cancel the job? The answer I got was the captured video also causes this issue.

One of the reasons I went with Final Cut and the Mac was to get away from some of the discussions where the software vendors say it's hardware, and the hardware vendors say it's software. Hadn't figured on Apple saying it's the Sony camera - If it's true, I'd like to understand why it's true.

The problems occurs after I submitted a single compressor job - the first time I did this, the Batch Monitor progress bar went to approx 50% and failed to continue past that point. I kicked it off at night, hoping it would be done in the morning. I thought it was possible the job may have stopped because the Mac/display went in sleep mode. So, I tried to cancel the job, but found this a challenge. The status never went past "Canceling".
I trashed the presets, emptied the trash, and repeated the process, on the first 5 minutes of the same video clip (original was 90 minutes long).
I was successful while playing around with the Compressor a few weeks ago, but it wasn't via FCP export.
There are too many things I don't know - thought I'd include things that looked odd/suspicious to me.
--------------------------------------------------
The first time I tried this the Batch Monitor listed Video 01:00:11:07 to 01:00 22:11 Failed
The second time I tried this the Batch Monitor listed Video 01:00:33:17 to 01:00 44:21 Failed
In both cases, the log showed Status: Failed - HOST [mco-mac-pro.local] Final Cut Pro generated an error or unexpectedly quitUser aborted Media Server.
I would think if it was a problem in the video, the compressor failure would occur at the same position.

I also saw a couple entries in the Console Manager that didn't look right:
12/24/08 1:43:53 PM Compressor[164] Could not find image named 'MPEG1-Output'.
12/24/08 1:43:53 PM [0x0-0x22022].com.apple.compressor.Compressor[164] Movie codec dvc specified manufacturer appl not found --- found one for different mfr: 'gdw '

I see the CompressorTransocder, ContentAgent, and Final Cut Pro are not responding when I check the Activity Monitor. This is so beyond my comfort zone - I did notice an odd thing in the Batch monitor log - pnm="unknown"

Here is a bit of the log:
<?xml version="1.0" encoding="UTF-8" standalone="yes"?>
<services>
<service address="tcp://127.0.0.1:49165" type="jobcontroller:com.apple.qmaster.cluster.admin" hostName="mco-#4-mac-pro.local" displayName="mco #4 Mac Pro">
<logs tmt="12/24/2008 13:40:39.155" pnm="unknown" tms="251847639.155">
<mrk tms="251847639.157" tmt="12/24/2008 13:40:39.157" pid="93" kind="begin" what="log-session"/>
<log tms="251847639.164" tmt="12/24/2008 13:40:39.164" pid="93" msg="Starting up"/>
<log tms="251847639.181" tmt="12/24/2008 13:40:39.181" pid="93" msg="Keep completed targets in history = true"/>
<log tms="251847639.181" tmt="12/24/2008 13:40:39.181" pid="93" msg="Keep completed segments in history = false"/>
<mrk tms="251847639.192" tmt="12/24/2008 13:40:39.192" pid="93" kind="begin" what="CJobControllerService::publishClusterStorage"></mrk>
<log tms="251847639.192" tmt="12/24/2008 13:40:39.192" pid="93" msg="Cluster storage URL = file2nfs://localhost/private/var/spool/qmaster/1C831B95-C1A50D34/shared/"/>
<log tms="251847639.192" tmt="12/24/2008 13:40:39.192" pid="93" msg="Publishing shared storage."/>
<log tms="251847639.204" tmt="12/24/2008 13:40:39.204" pid="93" msg="Result cluster storage URL = nfs://mco-#4-mac-pro.local/private/var/spool/qmaster/1C831B95-C1A50D34/shared"/ >
<mrk tms="251847639.204" tmt="12/24/2008 13:40:39.204" pid="93" kind="end" what="CJobControllerService::publishClusterStorage"></mrk>
<log tms="251847969.978" tmt="12/24/2008 13:46:09.978" pid="93" lvl="2" msg="Handling exception: batch = Waltz teach beginning-Untitled Project 1, job = Waltz teach beginning-Untitled Project 1, target = Waltz teach beginning-Untitled Project 1-MPEG-2 5.0 Mbps 2-pass.m2v, segment = Video: 01:00:33;17 to 01:00:44;21, host = mco-#4-mac-pro.local, fatal exception = Final Cut Pro generated an error or unexpectedly quitUser aborted Media Server, fail count = 1."/>
<log tms="251847970.005" tmt="12/24/2008 13:46:10.005" pid="93" msg="Stopping the failed request."/>
</logs>

*Any thoughts/ideas???*

Mac Pro 8 core, Mac OS X (10.5.5), 14 G ram, Caviar 1 T

Posted on Dec 24, 2008 4:31 PM

Reply

Answer 1

NibblesNBits Author

Level 1

1 points

Dec 24, 2008 5:10 PM in response to NibblesNBits

I just finished a test of taking the same video clip that failed to run in Compressor via a FCP export, and use Compressor to process the video clip directly. No problems compressing the video clip - this would suggest, to me, that the video capture wasn't the issue. Not being able to Export from FCP makes a cumbersome workflow, and hopefully the problem can be isolated.
Any thoughts on why it wouldn't work via FCP?

Reply

Answer 2

Dec 25, 2008 12:35 AM in response to NibblesNBits

If you look on this page, you'll see that the TVR30 isn't supported:
http://www.apple.com/finalcutstudio/resources/supportdevices.php

That doesn't mean it won't work, it just means that Apple won't offer you any support for it. I doubt that is the issue though.

I need a bit more info:
1. What format is the QuickTime file you are bringing into Compressor?
2. Can you drag other QuickTime files in and successfully compress them?
3. Which version of Compressor do you have?
4. Are you exporting to a cluster? If so, have you tried compressing using This Computer?
5. Do you have any other codec packs such as Perian, or anything installed that might be conflicting with the default Apple MPEG-1 codec?
6. Have you also tried trashing the Qmaster folder in /var/spool/qmaster? (note: you cannot browse to this directory because it is hidden. In Finder, go to Go > Go to Folder and type it in manually).

Reply

Answer 3

NibblesNBits Author

Level 1

1 points

Dec 25, 2008 10:32 AM in response to Jon Chappell

Jon Chappell wrote:
If you look on this page, you'll see that the TVR30 isn't supported:
http://www.apple.com/finalcutstudio/resources/supportdevices.php

That doesn't mean it won't work, it just means that Apple won't offer you any support for it. I doubt that is the issue though.

I had seen it wasn't on the list, but that's what was used to record the video.

I need a bit more info:
1. What format is the QuickTime file you are bringing into Compressor?

I had used "Log and Capture" with a DV-NTSC setup. When viewing in the finder (Get Info) - Dimension 720 x 480;Codecs: DV/DVCPRO - NTSC, Integer (Little Endian), TimeCode; Channel Count 2; Total bit rate 30,288

2. Can you drag other QuickTime files in and successfully compress them?

I haven't tried dragging any other QT files into FCP, but will give that a try - not sure where to get a QT file I can be sure doesn't have it's own issues. It would be useful info if the file compressed, but inconclusive if it didn't. I'll try a piece from the Studio.

3. Which version of Compressor do you have?

version is 3.05

4. Are you exporting to a cluster? If so, have you tried compressing using This Computer?

I've been exporting to clusters in both tests - e.g., via FCP, and directly from Compressor. I have the 5 cores allocated for Compressor.

5. Do you have any other codec packs such as Perian, or anything installed that might be

conflicting with the default Apple MPEG-1 codec?
I haven't added anything additional to the FCP Studio - so, would think there wouldn't be a conflict.

6. Have you also tried trashing the Qmaster folder in /var/spool/qmaster? (note: you cannot browse to this directory because it is hidden. In Finder, go to Go > Go to Folder and type it in manually).

I've been using your repair tool between tests, and have been verifying the spool folders are cleared out.

The one line if the Batch Monitor log that looked significant to me was,

:
Waltz teach beginning-Untitled Project 1-MPEG-2 5.0 Mbps 2-pass.m2v, segment = Video: 01:00:33;17 to 01:00:44;21, host = mco-#4-mac-pro.local, fatal exception = Final Cut Pro generated an error or unexpectedly quitUser aborted Media Server, fail count = 1."/>

and, the line in the Console Manage,

:
12/24/08 1:43:53 PM 0x0-0x22022.com.apple.compressor.Compressor164 Movie codec dvc specified manufacturer appl not found --- found one for different mfr: 'gdw '

When you export from FCP to the Compressor, I'm guessing that there is handshaking that takes place - does the line in the Batch Monitor log suggest the handshaking didn't work quite?
And, the entry about the Compressor164 Movie codec dvc specified... - does that mean anything?

I didn't look at the Console Manager log to see if there were any issues raised when I was successful in compressing via Compressor directly. I will run the test again, and check the log.

The Apple tech said that the Sony TRV30 wasn't supported - When I asked if that meant it didn't work with FCP Studio, or if it wasn't included in tests, he said the TRV30 has been known to have problems with FCP. When I asked what were the problems in the video, he said there was a problem with the Iframe, Pframe, Bframes. This didn't make sense to me, but I know nil about this area - I would think these would be inserted by the compressor during compression process - possibly, his statement meant the video was recorded in a way that made it difficult for the compressor to insert Iframe, PFrame, BFrame.
Hope your weather is better than ours (S.F. bay area)
Ho, Ho, H....

Reply

Answer 4

NibblesNBits Author

Level 1

1 points

Dec 26, 2008 8:44 AM in response to Jon Chappell

I haven't been able to locate a comparable clip I could use, but tried Macbreak studio clip and exported via compressor and submitted the job using the clusters.
I will rerun using This Computer once I have Forced Quit FCP, cleaned house and rebooted.
The clip had the following charateristics:
Dimension: 960 x 540
Codecs: H.264, AAC, Timecode
total bitrate 602
Had the same behavior:
Processing service request error: Final Cut Pro generated an error or unexpectedly quitUser aborted Media
Log from Batch Monitor:
<?xml version="1.0" encoding="UTF-8" standalone="yes"?>
<services>
<service address="tcp://192.168.2.154:49160" type="servicecontroller:com.apple.stomp.transcoder" hostName="michael-cohens-mac-pro.local" displayName="Michael Cohen’s Mac Pro 5">
<logs tmt="12/24/2008 17:20:46.436" pnm="unknown" tms="251860846.436">
<mrk tms="252001275.942" tmt="12/26/2008 08:21:15.942" pid="153" kind="begin" what="service-request" req-id="24300440-B0F5-44B4-AC22-FE7A2B8350DC:1" msg="Processing."></mrk>
<mrk tms="252001275.943" tmt="12/26/2008 08:21:15.943" pid="153" kind="begin" what="CServiceControllerServer::mountClusterStorage"></mrk>
<log tms="252001275.943" tmt="12/26/2008 08:21:15.943" pid="153" msg="Cluster storage URL = nfs://michael-cohens-mac-pro.local/private/var/spool/qmaster/7FBF8CB4-FDF3696C/ shared"/>
<log tms="252001275.944" tmt="12/26/2008 08:21:15.944" pid="153" msg="Local subscribe path = /var/spool/qmaster/7FBF8CB4-FDF3696C/shared"/>
<log tms="252001275.944" tmt="12/26/2008 08:21:15.944" pid="153" msg="Not subscribing, cluster storage is local and its path matches the local subscribe path."/>
<mrk tms="252001275.944" tmt="12/26/2008 08:21:15.944" pid="153" kind="end" what="CServiceControllerServer::mountClusterStorage"></mrk>
<mrk tms="252001275.944" tmt="12/26/2008 08:21:15.944" pid="153" kind="begin" what="CServiceControllerServer::checkRequiredFiles"></mrk>
<log tms="252001275.944" tmt="12/26/2008 08:21:15.944" pid="153" msg="Source file /var/spool/qmaster/7FBF8CB4-FDF3696C/shared/A5C0EB09-C05F-4F4E-88D7-99-8D6A4C14 -A456-4E28-91BB-2EC84FA700B2.fcp is directly accessible."/>
<log tms="252001275.944" tmt="12/26/2008 08:21:15.944" pid="153" msg="Source file can be opened."/>
<log tms="252001275.945" tmt="12/26/2008 08:21:15.945" pid="153" msg="Source file can be read."/>
<mrk tms="252001275.945" tmt="12/26/2008 08:21:15.945" pid="153" kind="end" what="CServiceControllerServer::checkRequiredFiles"></mrk>
<log tms="252001275.950" tmt="12/26/2008 08:21:15.950" pid="153" msg="starting _processRequest for job target: file://localhost/var/spool/qmaster/7FBF8CB4-FDF3696C/shared/MacBreak%20157 %20MacBreack%20Studio%20-CE5CC3F2-ABA2-4B09-98E5-0CB063FC785A.m2v-10"/>
<log tms="252001275.951" tmt="12/26/2008 08:21:15.951" pid="153" msg="Writing transcode segment: file://localhost/var/spool/qmaster/7FBF8CB4-FDF3696C/shared/MacBreak%20157 %20MacBreack%20Studio%20-CE5CC3F2-ABA2-4B09-98E5-0CB063FC785A.m2v-10"/>
<log tms="252001275.951" tmt="12/26/2008 08:21:15.951" pid="153" msg="MPEG-2 Transcode, rendering in 8 bit RGB"/>
<log tms="252001276.448" tmt="12/26/2008 08:21:16.448" pid="153" msg="Done _processRequest for job target: file://localhost/var/spool/qmaster/7FBF8CB4-FDF3696C/shared/MacBreak%20157 %20MacBreack%20Studio%20-CE5CC3F2-ABA2-4B09-98E5-0CB063FC785A.m2v-10"/>
<mrk tms="252001276.449" tmt="12/26/2008 08:21:16.449" pid="153" kind="end" what="service-request" req-id="24300440-B0F5-44B4-AC22-FE7A2B8350DC:1" msg="Processing service request error: Final Cut Pro generated an error or unexpectedly quitUser aborted Media Server"></mrk>
</logs>
</service>
</services>

Reply

Answer 5

NibblesNBits Author

Level 1

1 points

Dec 26, 2008 9:50 AM in response to Jon Chappell

I exported, from FCP, the Macbreak studio clip - when the compressor was set to use This Computer, it completed without any reported error - the only downside was it didn't have an audio track.
I am exporting, to Compressor (from FCP), the small video clip I captured which failed to compress when using the cluster. It's quite a bit larger, so don't expect to have it completed any time soon.
I'll post the results later

Reply

Answer 6

NibblesNBits Author

Level 1

1 points

Dec 26, 2008 1:38 PM in response to Jon Chappell

When I export the video clip, from FCP to the Compressor, it works fine when I select This Computer. No audio on this one either, but suspect I am violating some rules with the compression settings not suitable for the clip's video/audio. The video clip was captured with DV-NTSC,, with a codec of DV-NTSC 48khz. I had selected a DVD setting - MPeg2 5.0 MBbps (2 pass) for compression - the audio for the compression is 192 KBps - *Is this an issue*, or will the Compressor resample as needed?

Essentially, I've tried three different tests with the captured video, from the Sony DCR TRV30.
Export from FCP to Compressor using Clusters - get error
Export from FCP to Compressor using "This Machine" - no error
Using Compressor directly using Clusters - no error

Any thoughts/ideas?

Reply

Answer 7

Dec 27, 2008 12:09 AM in response to NibblesNBits

Those DVD presets don't automatically encode audio. Did you go to the Formats > Audio section and drag an AIFF onto the job as well? (as a side note: Dolby Digital 2.0 is a better choice because it has a better compression algorithm so there is extra headroom for raising the video bitrate when using it instead of AIFF).

If you can export using This Computer there is probably not an issue with the underlying Qmaster frameworks - it is most likely an issue with the settings you are using. How did you set up your virtual cluster? Did you follow these steps? (also see the comments for a discussion of how many cores to use)

http://www.digitalrebellion.com/blog/posts/usingcompressor_with_multiplecores.html

Reply

Answer 8

NibblesNBits Author

Level 1

1 points

Dec 27, 2008 9:36 AM in response to Jon Chappell

Jon Chappell wrote:
Those DVD presets don't automatically encode audio. Did you go to the Formats > Audio section and drag an AIFF onto the job as well? (as a side note: Dolby Digital 2.0 is a better choice because it has a better compression algorithm so there is extra headroom for raising the video bitrate when using it instead of AIFF).

Thanks for the tip on Dolby Digital 2.0 - I doubt if I would have ever used it with the audio recording setup I used.
I hadn't picked an audio encoder - at least prior to yesterday afternoon. I had been selecting a video encoder from one of the DVD folders, assuming the audio encoder associated with it would be used. *I thought, on an earlier test when I used an H.264 encoder, the audio was encoded as well*. Does that mean you can select a video encoder from one folder, and an audio from a different one - if not, why wouldn't the compressor software automatically use the audio encoder associated(in same folder) with the selected video encoder? Are there situations where one wouldn't want to encode the audio??

If you can export using This Computer there is probably not an issue with the underlying Qmaster frameworks - it is most likely an issue with the settings you are using. How did you set up your virtual cluster? Did you follow these steps? (also see the comments for a discussion of how many cores to use)

http://www.digitalrebellion.com/blog/posts/usingcompressor_with_multiplecores.html

I had set up the cluster per this instruction.
Yesterday, I talked with Apple, and they suggested I change the Qmaster setup from "QuickCluster with Services", to "Services and Cluster controller". Then I went into QAdministrator, created a cluster name, and I had thought I dragged an item from the Qmaster Service Browser to the grid just below the Controller dropdown list. However, I'm not sure if I recall correctly - when go back into the QAdministrator, I don't see any Qmaster Service Browser entries - It's possible the entries are only displayed if there are some that haven't been assigned to a cluster.
In any case, the exporting from FCP works without any errors, and I even get audio 🙂 - as long as I drag the folder (i.e., "DVD Best Quality 90 minutes" rather than picking the "MPeg-2 62 MBps 2-pass" from within the folder)
One thing I was told to do, was deselect the "Share" and "Managed" from the Rendering service. I would think I'd want this to get the benefits of the multiple cores.
Any thoughts on why this would work and not the QuickCluster approach?

Reply

Answer 9

Dec 28, 2008 1:24 AM in response to NibblesNBits

Audio varies depending on the preset you use. You can actually get audio with the MPEG-2 preset if you change it to a Program stream but this is limited to MP2 audio.

Yesterday, I talked with Apple, and they suggested I change the Qmaster setup from "QuickCluster with Services", to "Services and Cluster controller". Then I went into QAdministrator, created a cluster name, and I had thought I dragged an item from the Qmaster Service Browser to the grid just below the Controller dropdown list. However, I'm not sure if I recall correctly - when go back into the QAdministrator, I don't see any Qmaster Service Browser entries - It's possible the entries are only displayed if there are some that haven't been assigned to a cluster.
In any case, the exporting from FCP works without any errors, and I even get audio 🙂 - as long as I drag the folder (i.e., "DVD Best Quality 90 minutes" rather than picking the "MPeg-2 62 MBps 2-pass" from within the folder)
One thing I was told to do, was deselect the "Share" and "Managed" from the Rendering service. I would think I'd want this to get the benefits of the multiple cores.
Any thoughts on why this would work and not the QuickCluster approach?

I have to confess, I have never ever been able to get a cluster working from Qadministrator. Qmaster is very buggy, Qadmin is even more so. It will work for a while and then inexplicably not work without an error message. And those are the occasions when I was even able to set up a cluster. The Service Browser sometimes displays things in the list if you're lucky. So I don't use it for this reason.

I click Managed because it gives me an option in the Cluster dropdown menu in Compressor. This is good for two reasons - firstly it tells me that the cluster is up before I submit the batch (remember Qmaster is buggy so you can't always assume that) and it also allows me to choose which particular cluster I would like to use if there are multiple ones on the network. If you don't do this, you have to click the Unmanaged box and then ALL unmanaged services are used - this may not be what you want.

Reply

Answer 10

NibblesNBits Author

Level 1

1 points

Dec 28, 2008 9:09 AM in response to Jon Chappell

Yesterday, I changed the configuration of the cluster (went from 5 cores to 6) to see if it would show up in QMaster Service browser, and it did. However, after creating a new cluster with this configuration , I was unsuccessful running Compressor (via FCP). I have been unable to get that resolved - it feels like setting up a cluster is like balancing on the edge of a razor blade - can't move one way or the other without falling off the edge. Working with computers is not for the faint at heart 🙂

Reply

Answer 11

NibblesNBits Author

Level 1

1 points

Dec 29, 2008 2:22 PM in response to Jon Chappell

For what it's worth, I found the following KB article which says you will not be able to successfully export from Final Cut Pro using Compressor if your computer is set up as a Compressor QuickCluster, or a "Virtual Cluster".

http://support.apple.com/kb/TS1099?viewlocale=en_US

Reply

Answer 12

Dec 29, 2008 2:30 PM in response to NibblesNBits

Of course! (smacks forehead)

Totally forgot about that. Only one instance of the transcoder service is able to access FCP's resources. There is no limit on the number of processes that can read in a movie clip though.

Reply

Answer 13

NibblesNBits Author

Level 1

1 points

Dec 29, 2008 3:17 PM in response to Jon Chappell

Jon Chappell wrote:

Only one instance of the transcoder service is able to access FCP's resources.

Just for my own learning process - So does that mean all is fine when the first instance of Compressor "talks" with FCP, but when the second instance starts to work, FCP says essentially says "nobody home" - I'm busy?

There is no limit on the number of processes that can read in a movie clip though.

Are you saying that the "read in a movie clip" is basically a disc I/O operation that each Compressor can accomplish.
Why did this work on Friday, and not on Saturday? Is it possible, on a short clip, that one instance of the Compressor got involved, and a second one never was instantiated?

Reply

Answer 14

Dec 30, 2008 4:17 AM in response to NibblesNBits

NibblesNBits wrote:
Just for my own learning process - So does that mean all is fine when the first instance of Compressor "talks" with FCP, but when the second instance starts to work, FCP says essentially says "nobody home" - I'm busy?

Something like that, yeah.

Are you saying that the "read in a movie clip" is basically a disc I/O operation that each Compressor can accomplish.

Yep.

Why did this work on Friday, and not on Saturday? Is it possible, on a short clip, that one instance of the Compressor got involved, and a second one never was instantiated?

I have absolutely no idea I'm afraid. That's a mystery. Qmaster is the kind of software that regularly defies logic.

Reply

Answer 15

NibblesNBits Author

Level 1

1 points

Dec 30, 2008 8:54 AM in response to Jon Chappell

Thanks for the confirmation

Reply