Department of Homeland Security Secretary Kristi Noem's purse was stolen at a Washington restaurant over the weekend, according to a DHS official.