Luxury travel agencies pros/cons

I’m not interested in travelling on a tight budget or looking for the cheapest hotel/restaurant etc. I have limited vacation time and want to enjoy my travels to the fullest! But I haven’t had the best experience with local travel agencies so I want to try the more “prestigious” ones. What are some of the biggest pain points about luxury travel agencies like Abercrombie and Kent or Virtuoso? Are they as personalized and private as they seem or could they do better?