In the File Preferences panel, you can control the default working directory, which determines where the file browser starts when first launched for different file-browse activities within the interface, as well as file-selection histories. You can delete history entries if you do not want to see these in the list of options during file selection actions.