The danger of it is that you may be mistaken as a local woman.
with reference to the midnight harrasement by on an elderly American couple in Langkawi two months ago,
“Some locals saw the woman wearing sarong and thought that a khalwat (close proximity) had occurred at the apartment. It turned out that the woman was the wife. "
source : believe it or not, the article is titled "Don’t believe all news reports"