6 upvotes, 1 direct replies (showing 1)
View submission: BETA: Weekly Round-Up and Newsletter | 2020-04-03
That is an interesting result regarding the survey and comments. When you say the survey has an order of magnitude more responses, are you comparing that to the count of comments, or comments plus votes?
I suspect the reason survey responses are more positive and comments are negative is that commenters, like me, glanced at the message, saw you were sending spam, and came to complain without reading further or noticing their was a survey. I certainly didn't notice there was one. People who liked the message likely paid more attention to it and noticed the survey link.
I don't think a survey is very good evidence here. I'd assume the vast majority of recipients didn't respond at all. If you just ignore these people then you're listening to a biased sample from either surveys or comments. A passive metric would be better, e.g. if reddit metrics could tell how long people had the message open for you could infer how many actually read it. The passive metric is better because it doesn't require an active response from the users.
It's also a problem to ask people to evaluate this when they're only getting one notification from one relatively high quality sub. This feature will seem much worse when every random subreddit is spamming every subscriber.
Comment by Georgy_K_Zhukov at 04/04/2020 at 19:27 UTC*
5 upvotes, 1 direct replies
As I said, we'll be listening to both, and I'm hoping reddits site data will be able to give us a wider look than either, even if it might not give us the voice that the survey and comments do.
[EDIT: for the record, the user self-deleted after getting a few downvotes. Nothing was removed by the mods in this chain]