"Users demand delightful experiences (see: Pinterest, Square, Path), but at what point does polish get in the way of finding product market fit?"
I believe you should almost always distill your idea into the smallest chunk possible that still contains the core of the idea and ship it.
John's comments in this branch I think are spot on: You don't know how your users will use your idea until they use it, so don't spent a ton of time polishing things because there's a good chance that things will change drastically and you will have wasted a bunch of time on polish.