Media Engine Access for Implementing it on Application Level

Question

Media Engine Access for Implementing it on Application Level

TL;DR: Is there any documentation/application/tool/library for using Media Engine in M2 Pro chip which would provide faster operations on video processing tasks?

Hey all,

I have bought 2023 Macbook Pro with M2 Pro chipset. The main reason why I chooesed this device over others was its Media Engine and Neural Engine apart from its CPU. Now, for my video processing works, I need to use Media Engine features, however couldn't find a documentation on it. I'm looking something like core-ml-tools for Neural Engine, something will let me use the Media Engine -- it can be either an application, a CLI tool, or a library that I can import on my program. Do you know anything about this chip?

Thanks!

MacBook Pro 14″, macOS 14.0

Posted on Oct 14, 2023 5:35 AM

Reply

Answer 1

Top-ranking reply

electricalgorithm Author

Level 1

4 points

Oct 14, 2023 5:46 AM in response to electricalgorithm

Solution found: I guess I'd need to change the keywords I was searching.

Video Toolbox | Apple Developer Documentation

"VideoToolbox is a low-level framework that provides direct access to

hardware encoders and decoders. It provides services for video

compression and decompression, and for conversion between raster image

formats stored in CoreVideo pixel buffers. (...)"

It seems that FFmpeg already supports the Media Engine functionality on Apple silicon:

❯ ffmpeg -hide_banner -encoders | grep VideoToolbox
 V....D h264_videotoolbox    VideoToolbox H.264 Encoder (codec h264)
 V....D hevc_videotoolbox    VideoToolbox H.265 Encoder (codec hevc)
 V....D prores_videotoolbox  VideoToolbox ProRes Encoder (codec prores)

Here is more info on FFmpeg's, from its documentation: https://trac.ffmpeg.org/wiki/HWAccelIntro#VideoToolbox

Reply

Media Engine Access for Implementing it on Application Level

Similar questions