In perfect conditions, you are fine towing that light of a trailer as long as it's not loaded to the max. But If you want to start packing the crap out of it and loading a 4 seater into it, you are pushing the limits of that truck. Add the possibility of bad weather, tire failure, people cutting out in front of you when your braking distance is limited, heavy winds, etc etc and it gets very dangerous. Every single person I have ever known who started towing a toyhauler with a half ton truck, ended up buying a 3/4 or 1 ton within a year. I can count about 7 or 8 people in which this was the case.
Try and get a brake controller? It's not an option. It's required. Every tow rig up to a one ton truck requires a brake controller in order to tow that much weight safely.