There's rarely a downside to having more braking ability, so if it's not a big deal to add brakes to the camper and a brake controller to your car, then you should do that.
That said, it also depends on the driving you're doing. 50 miles on familiar roads, low speeds, flat ground to the local campground - less of a need (if any) for additional brakes. Thousands of miles on unfamiliar roads at interstate+ speeds with many mountain passes to descend - much more need for additional brakes.
Your confidence/experience and peace of mind are another factor.