Teensy 3.5 and 3.6 are very nice boards and I do like them more than even the Arduino Due. But, they're pretty close to an Arduino Due and which you choose is kind of down to what you want to do.
Yep. I built a Joystick RC Controller and used Teensy because of the higher A/D resolution, Averaging, no need for Interrupt Timers, and all the mind numbing complex code to go with it.
I made it both with Arduino and Teensy. The Teensy is just much more accurate and 1/4 the code. Might try working with Raspberry Pi