If the physical is of secondary importance then what is its function to that which is of primary importance?
There is a danger to downgrading the physical over the non-physical, namely there is no access to the latter realm.
Justifications of this are in general claims of a priori knowledge and existence when we only have a posteriori knowledge to work with.