14

If the Community Evaluation review queue is only for beta sites to help determine if/when the site is ready for graduation (so it says in the answer to What are the review queues, and how do they work?) why has it suddenly appeared on Web Apps, which graduated from beta ages ago?

Is this a policy change or a technical glitch?

Improve this question
6
  • 2
    This is probably a glitch, but I think it'll be a good idea to run community evals on graduate sites (less often than betas, of course). Commented Feb 2, 2013 at 16:08
  • It's on Physics as well (Probably started Feb 1 UTC on both?). I've updated the faq to reflect this. I don't think it's a glitch, since there wasn't any statement denying that this happens. Aside from that, one of the sites the queue was tested on before it was rolled out was Ask Ubuntu, a graduated site. Commented Feb 2, 2013 at 16:14
  • 3
    Well, it does say "This review queue appears periodically on sites to evaluate the overall quality of the Q&A." Maintaining quality over time is just as important as starting off on the right foot. Commented Feb 2, 2013 at 16:34
  • @Tim: Indeed, but this just appeared on two sites I frequent quite a bit and I'd never seen it before. (Or even heard of it, and I try to stay on top of things here on Meta.) What little information I could find when I went searching said it was for sites currently in beta. Commented Feb 2, 2013 at 16:38
  • 1
    I believe it's a stand-in for these kind of manual evaluations. Commented Feb 2, 2013 at 16:41
  • 1
    I think they're indirectly telling you that allowing Web Applications to graduate was a mistake ;) Commented Feb 3, 2013 at 6:04

1 Answer 1

Reset to default
16

This is new. Now that we no longer have to run site evaluations manually ourselves, we figured we would expand them to graduated sites.

Tim Stone hit the nail on the head in his comment:

Maintaining quality over time is just as important as starting off on the right foot.

Now, this is somewhat experimental. If these evaluations prove too distracting or not particularly helpful on graduated sites, we'll turn them off. In the meantime, the queue should pop up for a week every 90 days.

Update: after reviewing the results and responses across the network, we have disabled these evaluations for graduated sites. If specific communities want to do a periodic spot check of their own, we can fairly easily provide a random sample set of questions to them, but otherwise... y'all are "free and clear" once the beta period ends. :)

Improve this answer
5
  • 3
    Feature request (should I post it separately?): don't do it for every site at once. For those of us who participate on several sites, it's a bit overwhelming. Commented Feb 3, 2013 at 19:39
  • @Gilles Don't worry about posting it separately. There's probably always going to be some overlap (we have a lot of sites), but I'll see what we can do. Commented Feb 3, 2013 at 20:16
  • @Gilles If I recall correctly, there will always be several sites running simultaneously, but not all sites will run together. So, 5 sites might have evals going at any given time, but it'll be rare indeed if all 90+ have an eval running. Commented Feb 4, 2013 at 4:50
  • 3
    @Aarthi Aren't all non-trilogy sites having an eval right now? At least all the ones I participate on. Commented Feb 4, 2013 at 9:46
  • 1
    @Gilles Almost all. There are a few that aren't running right now for various reasons. We'll stagger future ones a bit better. Commented Feb 8, 2013 at 17:28

You must log in to answer this question.

Start asking to get answers

Find the answer to your question by asking.

Ask question

Explore related questions

See similar questions with these tags.