I think something should be said. Its one thing to pay her compliments, but giving a married woman (not your spouse) flowers and saying "if only" is inappropriate and way over the line IMO.
If nothing comes of "whats said", then there's always sexual harrasment lawsuits...
