This is definitely not normal behaviour.
Did you check the maintenance manager for any damage? Do you have some kind of hardware that could be overriding the trims?
As a last resort, you could try deleting the contents of preferences folder and re-calibrating, but this a rather drastic step.
Also, we ask that you don't compare the TBM to other aircraft. Reason being, for example, the pocket rocket has a completely different autopilot to the TBM. The TBM requires the AP Trims switch to be turned on before the Autopilot will work. Regardless of the AP button being pressed on the Autopilot panel.
There is a lot of code behind each system on the TBM, and much of it works outside of the X-Pane envelope.
You're more than welcome to join the Hot Start discord. There may be someone who has experienced the same thing as you have, who may be able to help you.
https://discord.gg/nW4pkw