4 upvotes, 2 direct replies (showing 2)
View submission: BETA: Weekly Round-Up and Newsletter | 2020-04-03
Yes, we plan to publish the report. I would note that, as I said elsewhere, we sent this a lot of users. The number replying here reflect less than 1 percent of them, so we don't consider them *necessarily* representative. The survey has an order of magnitude more responses, and shows quite the opposite with generally positive feedback, although it too is nowhere clear to 100 percent feedback. Interesting question to ponder is why people who like it are more inclined to only do the survey, while people who don't are inclined to post a comment too... We can only speculate.
We'll be taking both those into accounts, as well as the data from the Admin side of things from their own metrics.
In any case though, yes, the report we make to the Admins will be posted as a META thread most likely, although we won't use the message blast to send it out so you'll need to keep an eye on the sub.
Comment by electricfistula at 04/04/2020 at 19:09 UTC
5 upvotes, 1 direct replies
That is an interesting result regarding the survey and comments. When you say the survey has an order of magnitude more responses, are you comparing that to the count of comments, or comments plus votes?
I suspect the reason survey responses are more positive and comments are negative is that commenters, like me, glanced at the message, saw you were sending spam, and came to complain without reading further or noticing their was a survey. I certainly didn't notice there was one. People who liked the message likely paid more attention to it and noticed the survey link.
I don't think a survey is very good evidence here. I'd assume the vast majority of recipients didn't respond at all. If you just ignore these people then you're listening to a biased sample from either surveys or comments. A passive metric would be better, e.g. if reddit metrics could tell how long people had the message open for you could infer how many actually read it. The passive metric is better because it doesn't require an active response from the users.
It's also a problem to ask people to evaluate this when they're only getting one notification from one relatively high quality sub. This feature will seem much worse when every random subreddit is spamming every subscriber.
Comment by [deleted] at 05/04/2020 at 06:48 UTC
-1 upvotes, 1 direct replies
[deleted]