ProResRAW S-Gamut3.cine LUT several levels underexposed in Highlights at ISO 12800

I'm a new user to Final Cut and I can't get my head around this issue:

I've been shooting a lot of ProResRAW over the past two years, but never managed to edit it properly, which I am now attempting. My Project is set to Rec. 2020 PQ. I'm working on a Base Model Mac Studio M2.


All my footage has been shot in S-Log3/S-Gamut3.Cine on an A7SIII, nearly 99% of it at either 640 ISO (Base Slog3) or 12800 ISO (unofficially second Base).


Final Cut however automatically apllies the S-Gamut3 camera LUT (without the .Cine).

The image is slightly underexposed with that LUT. And the image is quite noisy (for a lack of a better word, it's just not looking good and saturated at some parts). This is true for both ISOP 640 as well as 12800 - both are slightly underexposed.

Anyways, I change the LUT manually to the correct .Cine LUT.


Well, here lies the issue.

At 640 ISO the image get's a bit brighter again, it is now properly exposed and clean. Apart from Final Cut choosing the wrong LUT, I can now continue work with these files without any worries.


At 12800 ISO however, the image gets very dark. It is as clean as I want it to be now, but it's completely underexposed.


For example:

A clip at 12800 ISO with the wrong lut (no .cine) is peaking at slightly above 2k cd/m2 in the Waveform, as I said, slightly underexposed and "noisy".

When I change the LUT to the correct one, it is peaking at 150-ish cd/m2. I can then push the highlights into oblivion (aka 90-100%) and I'm at the level where it should be. The shadows and mid levels are perfectly fine though. It's just the highlights that need a big push.


So even though I kinda have a workaround by pushing the highlights, this makes it quite a bit harder to properly work with. I have several clips where the colors are crazy hard to work with after needing to push the highlights.


Any idea on what I can improve? And maybe even an idea on how I can batch-change the camera LUT since Final Cut for whatever reason chooses the wrong one (I checked again today: camera raw output and Ninja V are properly set to process .cine but final cut doesn't add it, neither at 640 nor 12800 ISO).


Thanks

Mac Studio (2023)

Posted on Feb 17, 2024 4:18 PM

Reply
Question marked as Top-ranking reply

Posted on Feb 18, 2024 8:05 AM

Thanks for your input, this really helps me a lot understanding everything better.

I tried a bit more with the normal S-Gamut3 LUT, and it appers to be good (the colorspace in S-Gamut3 is actually a bit bigger in the greens than with .cine), when I adjust the exposure to be the same with the cine LUT, it also basically looks the same. So a little bit of oversight here, so I'm thankful again for your input that pushed me to check again.

Basically I think the only problem really is that you are expecting that the S-Gamut3.Cine Lut should work and it doesn't, at least not with the ISO 12800 shot. As you say it makes the 12800 shot look incredibly dark. Just use the default S-Gamut3 Lut and all is fine. You still need to do a bit of grading in FCP but that is normal.

As you said, the problem just seems to be the LUT not working as expected. I'll probably create a bug report. In my opinion this should work, especially since it seems to be bound to ProRes RAW only, XAVCS-I works fine with this LUT.

One important thing. Your approach to dealing with what you are seeing as underexposure is incorrect. You should not push the highlights beyond 1000 Nits as in the scopes you provide. If the clips come into FCP with highlights above 1000, then pull it back so they are at 1000 max. If they are clipping, indicated by a flat line, there is nothing you can do. You need to make sure you don't clip when shooting.

I left the examples in the screenshots just as they were when after the LUT was applied. I honestly don't even know why the first one is so high. I'm always shooting with the exact same settings, and I always try to expose for the highlights (sometimes it's not possible, but usually it is). So when I determine the brightness, I make sure there is no highlight clipping and that's usually the point to which I am exposing and happy. I'd rather have an image slightly overexposed as long as it is not clipped. I was planning to go for 1000 Nits in the edit, since the Ninja V has a 1000 Nits screen and was my reference when shooting, so I more or less now: If I aim for 1000 Nits and get the LUT done properly, I'm at the starting point I was looking at when shooting.

Anyway, I downloaded the two clips and imported them into a Rec2020 HDR PQ Library as it is impossible to tell anything with the screenshots. The 640 clip is too glary to really say anything much about what was intended. Either Lut will work. The 12800 shot looks ok to me if left at the FCP automatic default S-Gamut3 Lut although it looks overexposed. I pulled it down using the Color Wheels so everything is sitting below 1000 Nits. The sky is clipped so there is nothing you can do about that but it grades up fine if you pull the shadows down and play around with the rest. It is way too blue so especially in the shadows and unfortunately there is no raw adjustment for you camera but you can use the wheels to warm it up.

Yeah these were probably not the best clips, but they worked to show you the point of the LUT not working as expected. The 640 clip is pretty much showing what it's supposed to show, it was just a lot of fog over a lava field in weird lighting conditions one morning. I agree on the 12800 clip. The sky in the first second is clipped, but isn't visible in the rest of the scene. This was exposed to the blues in the waterfall which sit a bit lower and aren't clipped (as I described my process of exposing above). The white balance is off, but as you already said fixable. On Iceland I shot almost everything in Auto WhiteBalance (usually a sin in my books), but conditions change so frequently, you can't keep up with all the adjustments you'd have to make. So I'd rather fix it in post which is "good enough". Shame that there is no RAW adjustment, especially since you can adjust ISO.


Thanks though for the tips, very grateful for them anyways, they give me some more confidence that I'm not completely on the wrong track. :)

Really there is nothing written in stone that says you have to use any particular Lut. Just use what works best.

True. I'd just would've liked to use the "correct" one beacuse of the slightly different color space. Realistically I probably won't notice it anyways, since it's just the greens.

Similar questions

15 replies
Question marked as Top-ranking reply

Feb 18, 2024 8:05 AM in response to Clint Gryke

Thanks for your input, this really helps me a lot understanding everything better.

I tried a bit more with the normal S-Gamut3 LUT, and it appers to be good (the colorspace in S-Gamut3 is actually a bit bigger in the greens than with .cine), when I adjust the exposure to be the same with the cine LUT, it also basically looks the same. So a little bit of oversight here, so I'm thankful again for your input that pushed me to check again.

Basically I think the only problem really is that you are expecting that the S-Gamut3.Cine Lut should work and it doesn't, at least not with the ISO 12800 shot. As you say it makes the 12800 shot look incredibly dark. Just use the default S-Gamut3 Lut and all is fine. You still need to do a bit of grading in FCP but that is normal.

As you said, the problem just seems to be the LUT not working as expected. I'll probably create a bug report. In my opinion this should work, especially since it seems to be bound to ProRes RAW only, XAVCS-I works fine with this LUT.

One important thing. Your approach to dealing with what you are seeing as underexposure is incorrect. You should not push the highlights beyond 1000 Nits as in the scopes you provide. If the clips come into FCP with highlights above 1000, then pull it back so they are at 1000 max. If they are clipping, indicated by a flat line, there is nothing you can do. You need to make sure you don't clip when shooting.

I left the examples in the screenshots just as they were when after the LUT was applied. I honestly don't even know why the first one is so high. I'm always shooting with the exact same settings, and I always try to expose for the highlights (sometimes it's not possible, but usually it is). So when I determine the brightness, I make sure there is no highlight clipping and that's usually the point to which I am exposing and happy. I'd rather have an image slightly overexposed as long as it is not clipped. I was planning to go for 1000 Nits in the edit, since the Ninja V has a 1000 Nits screen and was my reference when shooting, so I more or less now: If I aim for 1000 Nits and get the LUT done properly, I'm at the starting point I was looking at when shooting.

Anyway, I downloaded the two clips and imported them into a Rec2020 HDR PQ Library as it is impossible to tell anything with the screenshots. The 640 clip is too glary to really say anything much about what was intended. Either Lut will work. The 12800 shot looks ok to me if left at the FCP automatic default S-Gamut3 Lut although it looks overexposed. I pulled it down using the Color Wheels so everything is sitting below 1000 Nits. The sky is clipped so there is nothing you can do about that but it grades up fine if you pull the shadows down and play around with the rest. It is way too blue so especially in the shadows and unfortunately there is no raw adjustment for you camera but you can use the wheels to warm it up.

Yeah these were probably not the best clips, but they worked to show you the point of the LUT not working as expected. The 640 clip is pretty much showing what it's supposed to show, it was just a lot of fog over a lava field in weird lighting conditions one morning. I agree on the 12800 clip. The sky in the first second is clipped, but isn't visible in the rest of the scene. This was exposed to the blues in the waterfall which sit a bit lower and aren't clipped (as I described my process of exposing above). The white balance is off, but as you already said fixable. On Iceland I shot almost everything in Auto WhiteBalance (usually a sin in my books), but conditions change so frequently, you can't keep up with all the adjustments you'd have to make. So I'd rather fix it in post which is "good enough". Shame that there is no RAW adjustment, especially since you can adjust ISO.


Thanks though for the tips, very grateful for them anyways, they give me some more confidence that I'm not completely on the wrong track. :)

Really there is nothing written in stone that says you have to use any particular Lut. Just use what works best.

True. I'd just would've liked to use the "correct" one beacuse of the slightly different color space. Realistically I probably won't notice it anyways, since it's just the greens.

Feb 20, 2024 5:07 PM in response to joema

Another issue is the ProRes RAW metadata indicates the material was shot on a Ninja V with firmware 10.62. That is a very old version, and RAW white balance and ISO were not fully supported. That support happened at Ninja V firmware 10.64, which was released on 24 May, 2021. The current firmware version is 11.04.01.


That is why the RAW controls in the FCP Inspector do not display a color temp adjustment. There is an ISO adjustment, even though the Atomos release notes say that was not added until 10.64.


In general, I'd recommend the camera and Atomos devices be on newer versions of firmware.

Feb 18, 2024 5:00 AM in response to tmpvc

Basically I think the only problem really is that you are expecting that the S-Gamut3.Cine Lut should work and it doesn't, at least not with the ISO 12800 shot. As you say it makes the 12800 shot look incredibly dark. Just use the default S-Gamut3 Lut and all is fine. You still need to do a bit of grading in FCP but that is normal.


One important thing. Your approach to dealing with what you are seeing as underexposure is incorrect. You should not push the highlights beyond 1000 Nits as in the scopes you provide. If the clips come into FCP with highlights above 1000, then pull it back so they are at 1000 max. If they are clipping, indicated by a flat line, there is nothing you can do. You need to make sure you don't clip when shooting.


Anyway, I downloaded the two clips and imported them into a Rec2020 HDR PQ Library as it is impossible to tell anything with the screenshots. The 640 clip is too glary to really say anything much about what was intended. Either Lut will work. The 12800 shot looks ok to me if left at the FCP automatic default S-Gamut3 Lut although it looks overexposed. I pulled it down using the Color Wheels so everything is sitting below 1000 Nits. The sky is clipped so there is nothing you can do about that but it grades up fine if you pull the shadows down and play around with the rest. It is way too blue so especially in the shadows and unfortunately there is no raw adjustment for you camera but you can use the wheels to warm it up.


Really there is nothing written in stone that says you have to use any particular Lut. Just use what works best.




Feb 21, 2024 8:09 AM in response to joema

Thanks for your input @joema.


Currently I'm only using a LG 40WP95X, which peaks at only 300nits (connected via Thunderbolt 4). The monitor is said to be calibrated from the factory, but checking it again properly is on my to-do list. I'm also looking to get an Apple Studio Display to replace my good, but non-HDR second monitor, mainly for the purpose of having an HDR monitor on the top as a reference monitor, and use the LG as a timeline monitor (as I intended it to be). Currently I'm just using it for HDR because it supports it, not because it's a great solution, even though except for peak brightness it's actually completely fine. That being said, are you satisfied with the Studio Display? I might just use my 32" Samsung as a third monitor then. It's still a great monitor, to good to sell, but having a nice HDR display for grading would be awesome as well!


Anyways, the color profile in the settings is called LG Ultrawide, I'm not sure if it was received from the monitor or if MacOS has a preset for this monitor. It get's the job done and from a different set of videos, the calibration seems to be pretty near perfect, at least from what I can tell by just looking at it and comparing it to the real life scene.


Overall I'm fine with the result I can get, I probably just assumed to get a perfect replica of the monitor preview when using the camera LUT. Which in hindsight wouldn't even make sense, since the FCP camera LUT is still different to the Sony LUT as well as the Ninja V PQ preview for example. What still stands is the issue with the 12800 ISO shots. Fixable, but annoying.


The fact that I only have firmware 10.62 installed is at least very annoying. I probably last updated it when I bought the A7SIII and I was activating ProResRAW. This would fit the timeline since I bought the camera in 02/2021.

I really should up my game to check for new firmware more often. My cameras are actually up to date, but thats probably because Sony doesn't release to many (big/important) updates after a year or so. The last notable was with the A7SIII getting S-Cinetone.

But it's good to know that there is actually white balance control with newer updates. And funnily enough, just today I got the same mail on two accounts that the Ninja V firmware is now able to update to version 11. So this time I wouldn't even have missed it without your help.


Thanks again for the input, I really appreciate it!

Feb 18, 2024 6:36 PM in response to tmpvc

Thank you for posting detailed screenshots and sample videos. I adjusted the brightness and darkness to the appropriate range. This is my method, but I hope it will be helpful.


--

1. Change library settings to Wide Gamut HDR


2. Project settings


3. Preferences: General: Check Automatic color matching


4. Load media(ISO 640) →Color adaptation in Video Inspector is “Automatic”


5. Camera LUT is automatically applied. *If blank, apply manually


6. Brightness adjustment


7. Load media(ISO 12800) →Camera LUT is automatically applied. *If blank, apply manually


8. Brightness adjustment



Adjusting the brightness was relatively easy as FCP automatically handles everything else except for 6. and 8.

I think it would be difficult to correct the overexposure in the upper left (sun) at ISO 640 or the bright sky at ISO 12800 by editing. Editing might have been easier if a half ND filter had been used to adjust the light intensity when shooting.

Feb 19, 2024 2:28 AM in response to tmpvc

tmpvc wrote:


There was very little info back in 2020 on how to grade in HDR in FCP. It has advanced a lot since then. I learnt by trial and error really. I guess it's the best way - make all the mistakes possible and you don't forget them.
Pretty much like the ProRes RAW workflow in Premiere Pro. There is a good reason why after years of trying I gave up. It's impossible to figure out properly since it's such a nieche to work with ProRes RAW and export to HDR at the same time. Since my Iceland Project is only personal but still already at least 12 months overdue I finally switched to Final Cut (and therefore to a Mac). Final Cut is a lot more user friendly, and I was convinced I made the right choice after just a day.

Thanks again!

Don't mention it. Happy to help. I use Adobe software for stills but I've never used Premiere Pro - the subscription price is very offputting. I use DaVinci Resolve for basic grading of Nikon Raw (NRAW) footage from the newer Nikon cameras, as FCP can't handle it unfortunately. However, I much prefer to work in FCP. There are far fewer choices than in Resolve for color management but it works reallly well for what it does. For me, it's basic grading in Resolve, export as ProRes and do everything else in FCP. Best of luck.



Feb 18, 2024 4:17 AM in response to LocaAlicia

Here is an image from the Project Settings (however i noticed that even in preview this occurs, so it has nothing to do with the project settings) - and before I forget it: I'm working with an HDR monitor and the preview is set to HDR Tonemapping, so this should also work.



For ProRes (RAW), Final Cut seems to just pick the "correct" LUT based on the informatin in the files, for my normal clips from the camera I have to choose the LUT manually. That's what I meant with automatically.


Here is an image shot at 640 ISO with the wrong LUT:


Here is the same file with the correct LUT applied:


Here is a file shot with 12800 ISO with the wrong LUT, notice the image quality in the greens e.g. (don't know if it comes through though, but there is a reduced quality there) :


And finally: The same vidoe file with the correct LUT applied:


As I said, in theory, the final image should be a bit brighter and correct exposed with the .cine LUT, same as it did with the first example at ISO 640.



The two clips shown in this example are available as a 1-second clip to download with this link.


Also: This problem is only affecting ProResRAW files. The same videos but with files straight out of my camera do not have these issue and behave correctly when I select the LUT.

Feb 18, 2024 10:25 AM in response to tmpvc

No problem - glad it helped. I have no experience with Sony video - I'm exclusively Nikon but the same general principles apply and it was interesting to have a look.


I'm happy to shoot auto white balance if I'm shooting raw (video and stills) although I know the purists say you should get it right in camera. That is too much messing about for me when I'm out and about and ProRes Raw white balance from the Nikons can be adjusted in FCP. This was a development in 2021 as previously it was not possible. There was very little info back in 2020 on how to grade in HDR in FCP. It has advanced a lot since then. I learnt by trial and error really. I guess it's the best way - make all the mistakes possible and you don't forget them.


I don't have enough knowledge to advise on wheter the Lut issue is a bug or intentional. There is a guy with username Joema who is an absolute expert on FCP and a Sony user who comes into this forum so hopefully he might see this thread and advise on this. I expect if it's a bug then he would know about it and have already reported it formally Apple.

Feb 18, 2024 11:09 AM in response to Clint Gryke

There was very little info back in 2020 on how to grade in HDR in FCP. It has advanced a lot since then. I learnt by trial and error really. I guess it's the best way - make all the mistakes possible and you don't forget them.

Pretty much like the ProRes RAW workflow in Premiere Pro. There is a good reason why after years of trying I gave up. It's impossible to figure out properly since it's such a nieche to work with ProRes RAW and export to HDR at the same time. Since my Iceland Project is only personal but still already at least 12 months overdue I finally switched to Final Cut (and therefore to a Mac). Final Cut is a lot more user friendly, and I was convinced I made the right choice after just a day.


Thanks again!

Feb 21, 2024 8:30 AM in response to tmpvc

tmpvc wrote:

Thanks for your input @joema.

But it's good to know that there is actually white balance control with newer updates. And funnily enough, just today I got the same mail on two accounts that the Ninja V firmware is now able to update to version 11. So this time I wouldn't even have missed it without your help.

I usually keep up to date with all firmware but I stopped updating my Ninja some time back as a lot of the more recent updates from Atomos have been related to features I have no interest in - Atomos Connect etc. Also they have made the update process quite complicated compared to what it used to be. I did get the firmware update for Nikon cameras which allows modifiying the white balance and ISO in FCP which is pretty essential. There was also a feature added that allows timelapse recording with output to ProRes Raw which is really useful.


This new update is a paid one. The only free one just updates the interface with no new features. I'm not going to bother paying for an update as I can record ProRes Raw and HEVC internally now in my cameras anyway.

Feb 21, 2024 8:50 AM in response to Clint Gryke

Also they have made the update process quite complicated compared to what it used to be. I did get the firmware update for Nikon cameras which allows modifiying the white balance and ISO in FCP which is pretty essential. There was also a feature added that allows timelapse recording with output to ProRes Raw which is really useful.

The only free one just updates the interface with no new features. I'm not going to bother paying for an update as I can record ProRes Raw and HEVC internally now in my cameras anyway.

Updating went as I remembered it for me: Download the zip file, copy the file inside to the SSD, plug it into the device and turn it on. Seemed pretty easy to me. Anyways, having Timelapse output to ProResRAW is actually something I might want to look into. I'm currently on the go, but I wanted to take a deeper dive into my issues here next weekend anyways, so maybe I can try around a bit.


The new interface is nice, but they removed the power off option under power where you had to hold the button on screen for a few seconds, and I can now for the life of me not find a way to power it down without a forced shutdown haha. Other than that it's the same for me. I'm happy with the internal recording and ProRes RAW on the Ninja, so no need for the paid update. However I think it's worth noting that they still offer new features for the original Ninja V, which by now is already a few years old. Might as well just throw it under the bus with the newest update and keep it at 10.x But there is probably to big of a usergroup with the Ninja V, that has no instentive to switch to V+ or Ultra.

Feb 21, 2024 9:15 AM in response to tmpvc


Updating went as I remembered it for me: Download the zip file, copy the file inside to the SSD, plug it into the device and turn it on. Seemed pretty easy to me. Anyways, having Timelapse output to ProResRAW is actually something I might want to look into. I'm currently on the go, but I wanted to take a deeper dive into my issues here next weekend anyways, so maybe I can try around a bit.


Yes you're correct. I can't remember now but I might have had to reactivate ProRes Raw that had to be done by scanning a QR code in the Ninja itself or by typing in a number from a new Activation tab. I just remember messing about quite a lot before I got it to work and thinking I'd avoid doing that again if possible.


The timelapse is well worth a look as you get all the benefit of a raw file in a timelapse video.

Feb 19, 2024 9:24 AM in response to tmpvc

I think part of the problem is ColorSync reads the designated ICC color profile of the monitor and adjusts tonal rendering based on that. This can be especially notable in a Rec2020 PQ project. E.g, without making any other changes in FCP, if you use MacOS System Settings>Displays>Preset to (for example) Apple Display (P3-600 nits), then FCP will visually show the image one way. But if you change the ICC profile preset to Rec.709, FCP will show the image differently -- while NOT changing the luma waveform.


The luma waveform is not derived from the final displayed image -- it is picked off the image pipeline before display ICC profiles are applied. IOW when working with an HDR project intended for HDR distribution and playback, it's vital to understand what ICC display profile you are using, and the characteristics of that profile.


In this regard I don't think there is a major difference between an S-Log3/SGamut3.cine 10-bit 4:2:2 XAVC-I MXF input file vs a simultaneously-recorded ProRes RAW file. IOW ProRes RAW is not inherently HDR. The dynamic range and color space are largely determined by the camera sensor. But when FCP sees a ProRes RAW file it assumes you want HDR processing and pops up the menu about an HDR library.


If you have a 1,000 nit monitor, is that connected via Thunderbolt or HDMI to your Mac (in which case it's managed by ColorSync) or is it connected via a hardware interface that bypasses ColorSync? In the first case, ICC profiles and ColorSync apply, but in the 2nd case they do not apply.


If your HDR monitor was calibrated, by what method? Was it using a Calibrite Display Plus or similar colorimeter which produced an ICC profile, or was the monitor hardware calibrated and a LUT downloaded to the monitor?


I downloaded your short files, imported them to an HDR library and Rec. 2020 PQ project and they look good on my Mac Studio display using the P3 - 600 nit ICC profile. If I have time, I'll reprofile the monitor using my Colorbrite Display Pro HL and see if it makes any difference.


Edit/Add: Reviewing LocaAlicia's results, I used a similar procedure and got about the same results. It looked good.

This thread has been closed by the system or the community team. You may vote for any posts you find helpful, or search the Community for additional answers.

ProResRAW S-Gamut3.cine LUT several levels underexposed in Highlights at ISO 12800

Welcome to Apple Support Community
A forum where Apple customers help each other with their products. Get started with your Apple Account.