Brown has "no problem" leaving the state