The Duke of Sussex didn’t bring his wife or children on the trip, as many wonder if he’ll visit with his father, King Charles, or brother, Prince William.