I would also need this. I am using 10gbit primary link, with a failover to 1gbit.
My workaround was to remove the active interface, which was the 1gbit from the lagg. I then got just one active connection which was the 10gbit. Then I re-added the 1gbit interface on the fly, and it became the failover.
I don't know what will happen if I reboot the box, but since we reboot maybe once a year, we can live with this for now.
But I would suggest that setting priority into the gui be implemented back into 11.3.