Siri-esque audio visualization?
Can anyone recommend a plugin or site that can generate animated visualization of speech that looks a bit like the Siri one? We have a scene where someone is conversing with a laptop. Thanks for any pointers.
You can make a difference in the Apple Support Community!
When you sign up with your Apple Account, you can provide valuable feedback to other community members by upvoting helpful replies and User Tips.
When you sign up with your Apple Account, you can provide valuable feedback to other community members by upvoting helpful replies and User Tips.
📢 Newsroom Update
Final Cut Pro 11 begins a new chapter for video editing on Mac. Learn more >
Final Cut Pro 11 begins a new chapter for video editing on Mac. Learn more >
Can anyone recommend a plugin or site that can generate animated visualization of speech that looks a bit like the Siri one? We have a scene where someone is conversing with a laptop. Thanks for any pointers.
Here's the download:
https://fcpxtemplates.com/sdm_downloads/siri-animation-effect/
Here's a working demo:
What's in the download:
Compromises were made. The Effect and the Project are 10 minutes long. A Build In Mandatory is used to maintain timing, so any application longer than 10 minutes will simply stop. The Effect cannot be "wired" to any audio - the Effect is "faked" by a randomizing setup.
There is a built in "In Animation" which can be varied from NO animation to 2 seconds.
The Animation is based on Start Point and End Point (and there are OSCs for you to position these). The OSCs will adapt to any media format that the Effect is applied to. You can move these locations anywhere you like, but animating only the End Point will be meaningful. The Start Point is useless after the first frame is played.
Highlight Visuals (the "flashing parts")
This is how it works: Whenever the parameter is an Integer value, there are no flashes. Whenever the value is a decimal/fractional, flashing occurs. You create timed flashing by **keyframing** the value over time from one integer value to a higher (or lower) one. When the frames are played, the parameter will pass through the decimal values and depending on how far you increment the value will determine the number of "beats" that occur. However, the effect is *further* randomized so that "beating" will become obscured and the "waveform" looks more "natural". Randomization incursion is influenced by the Frequency and how it is applied is also influenced by Random Seed. It is recommended to keep number spans and Frequencies less than 10 and experiment from there. Remember to occasional hit Random Seed to get better "audio matches".
As your video progresses, and you are "talking to Siri", you will need to set a Keyframe at the beginning of the flashing parts, move the playhead to the end of flashing and **choose a number to progress to**. You can continue this on for up to 10 minutes of "conversation" with Siri.
The Rest:
There is an optional Solid Background option.
A Color can be chosen and its Opacity can also be selected/keyframed as part of the overall effect (as in the video with the fade out at the end.)
You may set the Siri Size for either the whole length of the effect (except for In Animation which will start at 0), or animate this over the "life" of Siri.
Drop Shadow Opac. and Drop Shadow Dist. can be adjusted to taste. When animating Siri Size, you may also want to animate the Distance.
Show OSCs : OSCs are off by default, but can be turned on to maneuver Siri for In Animation setup.
The FCP Effect is locked, you will not be able to open it in Motion — it contains techniques which I prefer to keep private for now. The Composition is "open" so that the actual "artwork" is available.
Remember that your setups for the FCP Effect can be saved as Effects Presets. Save your setups *without* Highlight Visuals keyframing... you'll want to handle that on an individual application basis.
HTH
This is what I have so far:
The GIF looks terrible. Compare to a still:
I've got more to do... (tomorrow...)
Um... Audio response for a final cut template is not possible, but it is possible in Motion IF you import the audio, clear the "old" audio from the behaviors and hook up the new audio — it's a royal pita. It can be faked in FCP.
There are a lot of aspects to this. Animating on/off. As you talk, it gets larger and when it's idle, it reduces to about half size - it doesn't simply dismiss itself...
Bear with me. There are a lot of subtleties to work out.
A couple more screenshots:
"vocalization variations"
(still needs some work...)
I haven't enabled Siri on iPhone... (iPhone 7... don't even know if siri runs on it...LOL).
Isn't there a way to "screen capture" on iPhone? I don't need "great quality" -- just some idea how it progresses.
Ok - this is what I have so far:
How do you want the animation (onto the screen - off the screen) to be set up? Just like in the example you sent, or do you want manual control to be able to do more customized animations? Or would you like the template "as is" so you can modify it yourself in Motion?
Wow! Fox that's amazing! Will it also respond to audio the way the sample I sent shows? That's the most important thing. An onto-screen / off-screen animation would be a nice option but not necessary. Thanks again for taking this on!
Thanks again Fox for diving so deep into this. It's a bummer there isn't a direct way to use audio amplitude to drive an effect parameter. ffmpeg can export a csv of timestamps and RMS dB values for a given audio file (https://stackoverflow.com/questions/38056970/ffmpeg-txt-from-audio-levels). Could a plugin use this output as input to drive animation?
Fox, I have a piece of music I use an audio clip from Siri on. I'd love to have this when you're done. I don't mind using it in Motion only, not an issue for me (or anyone else, I'd imagine). Great work!
@BenB:
How to hook up the composition with audio.
1 Import your Audio clip
2 Locate "Link2Osc" in Group 2
3 disconnect all the behaviors (Randomize, Clamp, Link and Oscillate)
4 Right click on the Numbers > Value parameter and add an Audio Behavior
5 Drop the audio in the drop zone and let it "cook"
... Play ("Time" the audio clip — trim the Play Range)
HTH
Not aware of any. Would be a fun plugin to have. Check with MotionVFX.
Thanks Ben. First place I checked but didn't come across any.
Do you have an actual video sample of this?
Hi Fox. No. If you have an iPhone, it's the animation that runs when Siri is listening to you. Probably on the Mac too but I haven't enabled Siri on the Mac.
Hi Fox. Does this work?
https www filemail dot com slash d slash wdcvndwtmtdrzuc
Yep. That will work. May take awhile!
Siri-esque audio visualization?