The Verification System is a joke!

Rakuen

Edit history:

Rakuen: 2013-03-13 09:38:35 pm

2013-03-13 09:37:46 pm

Weegee Time

It could be edited into the front page of the KB if the front page of the site is too mystical. It's not the ideal place, but it is a place, and we should hopefully make more and more use of it as time goes on.

DK28

2013-03-14 12:06:05 am

General Kong - Bullets and Bananas

My Art of Fighting run was a full year from submission to posting and I know there's runs worse off than that. Normally I'd say "calm your tits", but these threads happen from time to time. Meh. Patience...

Sir VG

2013-03-14 01:30:16 am

Fucking Weeaboo

Quote from DK28:

My Art of Fighting run was a full year from submission to posting and I know there's runs worse off than that. Normally I'd say "calm your tits", but these threads happen from time to time. Meh. Patience...

One year? n00b.

Attachment:

Wahahaha.png

Klaige

2013-03-14 10:35:45 am

So OP: My latest run in the queue was verified before yours, and guess what? It's not up on the site yet. Do you want to know why this isn't a big deal? Because some of us realize that this site is run entirely by people who volunteer their time and effort to make it happen. Without the admins who put their own hard work into the site, we wouldn't have a site to begin with. There are tons and tons of runs that go through this process and people have had to wait longer than you have before. If the verification and posting system isn't satisfactory for you, then just don't submit runs here. If you want the world to see your run the second you get it there is this amazing place called "youtube".

It really pisses me off when someone complains about how things go through SDA. Is it the fastest process ever? Absolutely not, but SDA isn't anyones full time job, all the work put in here is done out of love and enjoyment for the site and community. You could have easily gotten some answers and looked like way less of a toolshed if you just sent a pm to one of the admins and asked them where the status of your run was at.

So OP:  My latest run in the queue was verified before yours, and guess what?  It's not up on the site yet.  Do you want to know why this isn't a big deal?  Because some of us realize that this site is run entirely by people who volunteer their time and effort to make it happen.  Without the admins who put their own hard work into the site, we wouldn't have a site to begin with.  There are tons and tons of runs that go through this process and people have had to wait longer than you have before.  If the verification and posting system isn't satisfactory for you, then just don't submit runs here.  If you want the world to see your run the second you get it there is this amazing place called  "youtube".

It really pisses me off when someone complains about how things go through SDA.  Is it the fastest process ever?  Absolutely not, but SDA isn't anyones full time job, all the work put in here is done out of love and enjoyment for the site and community.  You could have easily gotten some answers and looked like way less of a toolshed if you just sent a pm to one of the admins and asked them where the status of your run was at.

RabidJellyfish

Edit history:

RabidJellyfish: 2013-03-14 12:10:32 pm

2013-03-14 12:09:13 pm

Is it at all possible to make the backlog public? So we could see the general order of runs that have been accepted and are going to be put up on the site? I think I have a run that was accepted in October/November, and I think it'd be nice to see how many more runs are to be published before it so I don't have to hold my breath for every update.

I'm not going to complain about making it faster, I just think it'd be good to see how far back our runs are from being published.

Flip

2013-03-14 01:28:57 pm

1-Up!

cortez, please continue to complain about a free service run by volunteers. You have no idea how it motivates us.

DK28

2013-03-14 01:32:00 pm

General Kong - Bullets and Bananas

I know VG!!!! That same thread put us as weaboos in arms. Smiley

I was actually implying you when I put "There's runs worse off".

UraniumAnchor

Edit history:

UraniumAnchor: 2013-03-14 01:34:48 pm

2013-03-14 01:34:22 pm

Not a walrus

Quote from RabidJellyfish:

Is it at all possible to make the backlog public? So we could see the general order of runs that have been accepted and are going to be put up on the site? I think I have a run that was accepted in October/November, and I think it'd be nice to see how many more runs are to be published before it so I don't have to hold my breath for every update.

I'm not going to complain about making it faster, I just think it'd be good to see how far back our runs are from being published.

I believe the plan is to make it more public at some point, but right now it's extremely not-user-friendly. If the other admins don't mind I can give you some general statistics about what is in there right now, in a "how many runs are at what stage" sense.

kirbymastah

2013-03-14 03:40:04 pm

<(^_^)>

It might be best to stop feeding the troll, since he hasn't replied in a day, and he's actually currently online too.

UraniumAnchor

2013-03-14 03:41:02 pm

Not a walrus

I could change the thread title since this seems to be the 'ask questions about the queue' thread now.

dballin

2013-03-14 03:57:31 pm

Balls jerky

For curiosity's sake I'd like to see what's in what stage. I have nothing to gain or lose from it, but it might be interesting.

Emptyeye

2013-03-14 04:06:15 pm

Talk to the Hand

Wasn't the queue (In "how many runs are in what phase" form) actually public information at some point? And then either it was deleted or the link was simply removed for...some reason I forget.

UraniumAnchor

2013-03-14 04:27:47 pm

Not a walrus

It's because it was all manual and not very fine-grained and when the queue got bigger it became more confusing and a pain in the ass to update than anything else. It'll be back in some form once I get other things done that will actually speed up the updating process. Smiley

UraniumAnchor

Edit history:

UraniumAnchor: 2013-03-14 05:19:50 pm

UraniumAnchor: 2013-03-14 05:06:03 pm

UraniumAnchor: 2013-03-14 04:54:33 pm

2013-03-14 04:53:56 pm

Not a walrus

Mike said it was ok to give you some stats, so here you go:

- Runs Currently in the "Processing State": 222

This includes all submissions that are active but not published. They could be the fresh submissions we received yesterday, all the way up to stuff that's ready to go but hasn't been officially published yet. Note that some submissions contain multiple runs, but this is not all that common.

- Runs currently waiting on files for verification: 43

This number is actually lower than it sounds, because this includes stuff that we've received torrents for, but either nate hasn't had the chance to move them into the correct folder on the server, or the files haven't finished downloading, or are raw submissions that need to be re-encoded first.

- Runs currently in verification: 24

This includes private verifications, public verifications, and runs that are ready to hit public verification but haven't actually gone out yet because Flip doesn't want to have more than 6 of those active at any given time.

- Runs that have been accepted but still need video processing of some kind: 92

Before you jump in and say "holy shit that number is huge, how can I help?", this includes runs that we don't have the final *or* the raw files for, in which case we can't do anything until the runner sends us the proper files. It also includes several runs that have been stuck in limbo for a while because the runner is hard to reach and/or there's some issue with the files they sent us. No, I won't tell you who or what these runs are. This also includes runs that need their Game Page made.

- Runs that are probably finished but need to be checked for errors: 20

There's a small group of volunteers (they know who they are) we have that help us with this. This number includes runs that have been checked and have errors, which can be as minor as typos or mislabeling in the StatID or filenames, to more serious problems like the video/audio tracks having major corruption or in some cases missing entirely. We can't always fix this unless the runner sends us new files, so this can hold things up a bit. Usually this particular number is small, but we actually had a big clump of these hit this stage recently so it fell behind a little.

- Runs that are Ready To Post: 16

These are runs that are 99% of the way to being on the site. Usually all that remains here is making sure the video files are uploaded to the proper place, and one of the updaters writing an update. Lately we've been trying to stick to the schedule of about 6 runs every weekend, but this can vary.

In a perfect world none of these numbers would be in the double digits at any given time (other than the overall total, of course), but not all of them are under our control.

Also of interest, the number of runs that have been submitted in the last year, divided up by month, not including submissions that were cancelled for whatever reason, but it DOES include rejected submissions:

April 2012: 34
May 2012: 14
June 2012: 24
July 2012: 36
August 2012: 44
September 2012: 40
October 2012: 25
November 2012: 20
December 2012: 17
January 2013: 26
February 2013: 20
March 2013: 25 (so far)

Mike said it was ok to give you some stats, so here you go:

- Runs Currently in the "Processing State": [b]222[/b]

This includes all submissions that are active but not published. They could be the fresh submissions we received yesterday, all the way up to stuff that's ready to go but hasn't been officially published yet. Note that some submissions contain multiple runs, but this is not all that common.

- Runs currently waiting on files for verification: [b]43[/b]

This number is actually lower than it sounds, because this includes stuff that we've received torrents for, but either nate hasn't had the chance to move them into the correct folder on the server, or the files haven't finished downloading, or are raw submissions that need to be re-encoded first.

- Runs currently in verification: [b]24[/b]

This includes private verifications, public verifications, and runs that are ready to hit public verification but haven't actually gone out yet because Flip doesn't want to have more than 6 of those active at any given time.

- Runs that have been accepted but still need video processing of some kind: [b]92[/b]

Before you jump in and say "holy shit that number is huge, how can I help?", this includes runs that we don't have the final *or* the raw files for, in which case we can't do anything until the runner sends us the proper files. It also includes several runs that have been stuck in limbo for a while because the runner is hard to reach and/or there's some issue with the files they sent us. No, I won't tell you who or what these runs are. This also includes runs that need their Game Page made.

- Runs that are probably finished but need to be checked for errors: [b]20[/b]

There's a small group of volunteers (they know who they are) we have that help us with this. This number includes runs that have been checked and have errors, which can be as minor as typos or mislabeling in the StatID or filenames, to more serious problems like the video/audio tracks having major corruption or in some cases missing entirely. We can't always fix this unless the runner sends us new files, so this can hold things up a bit. Usually this particular number is small, but we actually had a big clump of these hit this stage recently so it fell behind a little.

- Runs that are Ready To Post: [b]16[/b]

These are runs that are 99% of the way to being on the site. Usually all that remains here is making sure the video files are uploaded to the proper place, and one of the updaters writing an update. Lately we've been trying to stick to the schedule of about 6 runs every weekend, but this can vary.

In a perfect world none of these numbers would be in the double digits at any given time (other than the overall total, of course), but not all of them are under our control.

Also of interest, the number of runs that have been submitted in the last year, divided up by month, not including submissions that were cancelled for whatever reason, but it DOES include rejected submissions:

April 2012: 34
May 2012: 14
June 2012: 24
July 2012: 36
August 2012: 44
September 2012: 40
October 2012: 25
November 2012: 20
December 2012: 17
January 2013: 26
February 2013: 20
March 2013: 25 (so far)

DK28

2013-03-14 08:25:34 pm

General Kong - Bullets and Bananas

^

ZenicReverie

2013-03-14 08:46:53 pm

Waiting hurts my soul...

So, there's a big influx at summer time it seems, also at spring break. I guess that makes sense.

presjpolk

2013-03-14 09:53:10 pm

HELLO!

I'm not one to say being a volunteer is a total pass on everything but I will say this: it'd be one thing if SDA people didn't care. But they clearly do care, and further they're taking concrete, identifiable steps to improve things, those things are visible, and they are working.

UraniumAnchor

2013-03-15 01:20:33 pm

Not a walrus

The new queue system keeps track of how long things stay at certain stages so it might be interesting to see how the statistics play out once we get caught up with things.

Of course, VG's Ace Combat 5 run being stuck for four years means we're going to have to use the median and not the mean.

MAS8705

2013-03-15 02:36:54 pm

SDA Apprentice -- (3-1)

Personally, I think that with all the changes implimented thus far as of recently, it should help the verification system in the long run. Of course it isn't perfect, but at least we could safely say that it is better now than it was a year or so ago. Granted I hope I'm not wrong when I say that. Improvements can always be made, but where things stand, it is a step in the right direction.

UraniumAnchor

2013-04-02 08:22:35 pm

Not a walrus

Runs submitted in March: 52.

__sdfg

Edit history:

__sdfg: 2013-04-02 08:31:58 pm

2013-04-02 08:29:55 pm

D:

I was going to ask about that.

And it looks like 25 of those are in verification now, and 8+ more have enough verifiers? Pretty cool.

LotBlind

2013-04-11 04:10:34 am

Wow how did it rocket to 52? Smiley

I'm really enthusiastic about having the public verification option, because it seems to help older submissions significantly. The secondary (and for me primary) reason is I feel more ready to verify those games when I don't need to think about how much of the game I played/did I finish it etc. More verification = more fun!

The topic of this thread could well be changed...

CarNage64

2013-04-11 04:35:38 am

Speed Runner

I Havent submitted a run yet, but when I do i have confidence it will go well hate flaming threads xD

zewing

2013-04-11 05:01:09 am

just( •_•)>⌐■-■ ..... (⌐■_■)wing it

The Big Push