Q: How do you enable dictation with smart keyboard?

I just received my iPad Pro and I am running iOS 9.3.1. When the smart keyboard is attached and you have tapped into a field you will see the prodictive typing toolbar at the bottom of the screen. In the bottom right corner will be a chevron that is pointing down. If you tap it the toolbar temporarily hides, If you tap and hold instead the on screen keyboard will appear and give access to the dictation mike. Hope this helps.

And if you press down on that one time, you will never see it again in any app until you go into settings and turn it off and back on again, making it useles.  If I have a keyboard, why would I want predictive typing?  I can type faster on a keyboard than clicking on predictive words, that just slows me down.  And yes I had pressed down on that once (no keyboard needs to be attached) and it's gone forever, unless you remember to turn it off and on again in the general settings area.

Now if it would go away when you pressed down on that, and came back up if you exited that window and came back or switched to a different app, that would work.  Why it doesn't work like this when you already have the option to turn it off period, is a bug, or a poor software design.  You should never have to turn something off and on again to get it back.  If that is the way it works, why would you need the switch at all??

The solution suggested by malja07 worked great for me.

I'm not sure I understand the issue that you're posing with that solution, Ourdoc. But I can say that I've used malja07's fix multiple times, without ever having to go back into settings to do anything along the lines you're describing. It's quick, easy, and much better on the longevity of the hardware (particularly the thin plastic that the keyboard is made from).

Push the down arrow without holding it.  The entire bar disappears and does not return.  The only way my iPad Pro will bring it back is by going into settings.  It's far too easy to hit it by accident or not long enough.  And if you forget, you will not see it again without resetting it.

Now if on others iPads it automagically reappears, then my iPad pro has bugs.  But my two neighbors who also have the iPad Pro say it works the same for them.  They hit that down arrow button on the first day, and didn't know it was available any longer as they never saw it again when I asked them about it yesterday.  In fact they had forgotten all about it until I asked them, and now have it back.

My point, as long as it is turned on in settings and remains on, when you lower the window or go out of window and then come back, so should that bar.

I'd bet the majority of people out there have forgotten that bar is even available...  NOt saying it doesn't work, just saying the acces to that bar is not what it SHOULD be.  If I have it ON in settings, why does it remain hidden until I turn it off and back on again?  I can see the use to turn it off in settings, but why off and on to get it back?

Huh -- sounds like a glitch in your setup, possibly.  When I hit the down arrow button, the bar does go away.  But the moment I enter a text field and start typing with the keyboard, it comes back up.  Confirmed on two others that it works the same for them.