Generally it's a function of the desired efficiency of the converter, and the switching losses versus frequency.
The switching losses are determined by the design of the converter.
Determining those losses is likely easiest done with an accurate Spice simulation of the circuit.
There is no "one size fits all" rule. As mentioned it does depend on your actual requirements and your ability to analyze and evaluate different choices. It may depend on factors that we are not even aware of which makes it difficult to address unless you have a more definitive set of requirements.