I ran a poll for Christmas. Let's see the results.

180 responses in one week. You're all Naughty.

Recap

"I had an idea." -Senty, 2024. On the 3rd of December this year, I had the glorious idea of making a survey that would automatically determine if a Stormworks player was on the Naughty or Nice list for Christmas. I partnered with an elf from the Subworks Discord to help make the Google Form, and within an hour we had a basic form.

We posted it in the Subworks Discord as a trial run, and it went pretty well. We got probably a dozen responses, and I decided to post it in a handful of other servers in the coming hours, including Shitpost Lane, TBEOS, Endoskull's server, the Reddit, Reddit Discord, and the Stormworks Modding Forums. Within an hour or two, we had two dozen responses, which was about the most I expected to get.

On the quiz, I had set it up so there were mostly multiple-choice questions that could be graded automatically, but there were still some text-based questions that required manual grading. The elf and I made it so that the quiz score was the primary determiner for what list responders went onto, but also decided that owning the Space DLC or being in Shitpost Lane also warranted being on the Naughty list. The two dozen responses we had so far meant that I had to sit down and manually grade one hundred responses. Luckily people usually didn't write essays for me to grade. I could never be an English professor.

I compiled the results into a Google Sheets spreadsheet and gave the elf access to it so he could see the responses. As my little elf was working away grading people, I had made a quick formula to automatically place people on the correct list based on their form responses. The inital formula we used was =IF(And(B2>11, E2<>"Yes", J2<>"Yes"), "Nice", "Naughty"), where the B column was the quiz score, the E column was if the user was apart of SPL or not, and the J column was if the user owned Space DLC or not. If all three conditions were met (quiz score is greater than 11, not in SPL, doesn't own space), the user was marked as Nice by the system. If any condition wasn't met, then the user was marked naughty. So it's not like it was hard to get on the nice list, but it was very easy to get on the naughty list. We eventually dropped the "Not owning space dlc" requirement for getting onto the nice list, meaning that even those with space could be nice.

After 12 hours, we had 50 responses. My elf and I kept close watch on the spreadsheet. The elf would go through everyone's text responses and would give a final verdict if a user was naughty or nice. He would sometimes dock users points if they thought XML editing was cheating (it's not). Of course, I asked him to not share any data. We weren't storing any sensitive information, only Discord or Reddit usernames. I intend to compeletely delete the data afer this whole experience is over.

We saw that the success rate, the rate of users that made it onto the nice list, was only about 40%. Turns out a lot of people, about 60% of those who did the form, own the space dlc. Unfortunate. This did mean, however, that most people were instantly being marked as Naughty even if they had perfect answers for everything else. So the Elf did drop the space DLC requirement and the success rate literally flipped, going from 40% to 60%.

We decided to close the poll after a week. One week after it went up, we had 180 responses. Over 3000 total answers. 900 manually graded answers. If you missed it this year, we'll probably do it again next. Next time I am making this much more automated. Thanks to everyone who participated, you'll be able to take a look at your responses below.

- Senty


If you are C4V it downloads a 17123121 petabyte zip bomb to your computer.

- Elf




Result summary

Insights

A total of 180 people took the quiz. Holy hell. I only expected maybe 25. As you'd expect, the total point distribution is a bell curve. Of course it is. With an average score of 12.6/16 (78%), most people passed the quiz. I set the passing threshold to be 11 points, ~69%. The median was 13 points, with 45 people getting that many points.

Particular shoutout to the two people who got 6 points and the one guy who got 18 points for a particularly good food answer involving good bacon. You know who you are. On the bright side, most people answered this form seriously. Some did not. I am not happy with those people.


My favorite part of looking at the overall results is seeing the just awful rates on some questions. I marked the correct answer for "Do you own Space DLC" as being "No", and since ~60% of people own it, most got that wrong. You're all wrong.

Questions

Do you think you're good or bad?

I don't think my intended meaning got through with the wording of this question. I'll just say it was supposed to be open to interpretation. I wonder what percentage of people read it as "Are you good at the game?" or "Are you good morally?" Because chances are if you play Stormworks, the answer is no to both.

95 people (53%) answered this correctly, saying they are not good at the game. The answer choice "Come on Santy you know we're all bad here" is particularly appreciated.

Are you a part of SPL?

I only made a small mistake on this one. I thought more people would know what SPL is. The moment I posted the poll to Reddit, the number of "What's SPL" answers doubled, and then tripled.

11% of players are in SPL? That can't be right. Maybe posting the form in SPL (ShitPost Lane, in case you're wondering. It's a Discord server) wasn't my brightest idea. Don't worry, an estimated 0.023% of all Stormworks players answered the poll. I don't have any remarks. Most people don't know what an obscure Discord server with only a couple hundred members (if that) is. Whoda thunk?

Have you ever XML edited?

To no one's surprise, most people XML edit. Although a smaller proportion than I thought. Reddit is going to play a key part of much of this. As I had the poll posted around Discord, most people had XML edited. I think the bias here is that, chances are if you're in one of the many Stormworks Discord servers that aren't the official one, you've probably XML edited before just because you've probably had more experience in the game than otherwise. That makes sense, right? But as I posted it to Reddit, more and more people said they hadn't XML edited.

Not to fret though, as 69% (nice) of respondents have XML edited. If we don't count Reddit users, that number jumps up to nearly 85%.

Do you think XML editing is cheating?

Spoiler alert, most people said no. Shoutout to the handful of people who said yes though. They were marked naughty. Some of the best responses include:

  • - Yes. I am a goober.

  • - Nah, it's just popcorn shrimpin'.

  • - eggsmell

  • - Yes, learn to play the game loser

  • - I don't know shit

  • - Yes and I will not elaborate.

Favorite Major Update?

I only listed some of the major updates that Stormworks has had. I decided to only list 1.0 and after because 1) I didn't want too many options and 2) Most people have joined the game after 1.0. Most people liked the Weapons DLC, for good reason. It's also the highest rated DLC, and at one point I think it was higher rated than the base game itself on Steam.

The top five updates are: Weapons, Modular Engines, Modding, 1.0, and Industry. Weapons has the plurality with 35% of players saying it's their favorite.

What do you hope the NEXT Major Update is?

I wanted to know what people thought the next major update was. Far too many people answered for optimizations or multiplayer fixes. Without getting too far into a tangent, the game is already about as optimized as it's going to get. Stop spawning massive vehicles in MP, and know what to expect from the game. And don't play on the public servers. Those suck. (I am now on many people's enemy list)

Many people wanted sails, one person remembered the motorcycle parts that were leaked some time back, one person asked for balls, many asked for bug fixes, but overall it was a pretty wide variety of suggestions. Too bad I can't forward this list to the devs. But I did dock points from anyone who asked for physics or MP improvements. It's fine. No, I'm not coping.

Do you own Stormworks: Space?

Ah, space. The final frontier. And by most, the worst update! Turns out a lot of people own space. 61%, in fact. I do hear the new components are good. And I would like to update my self-landing space rocket to use a liquid fuel engine instead of a jet engine at some point. Too bad I can't mod them in.

Have you ever committed a warcrime? (In Stormworks)

I mean, who hasn't purposely sunk the Hospital Ship at some point, am I right? Warcrimes an an essential component to the fun and replayability of Stormworks. Again, there's a reason that the Weapons DLC is so popular. Luckily, most people agree with me here in that warcrimes are Cool™. My good pal C4V has several "Warcrimes on a stick" that can be used to destroy pretty much any vehicle in any fashion. And of course myself, I can summon thermonuclear weapons where ever I please. Thank you, Deltars, for giving us players this magical ability.

78% of you have committed a warcrime at some point or another. Next year I'll have to rank who's committed the worst warcrimes. I'm disappointed in the other 22% of you though.

Favorite vehicle type?

The vehicle types in Stormworks can be boiled down to a handful of options: air, sea, land, space. Most people said either ship or plane (submarine and helicopter are also included in those categories). Some of my favorite responses are "Downtown Louisville", "Project 710 class attack submarine, now available on the steam workshop!" (Link to steamcommunity.com), "1995 suzuki swift", "echolodia", "Your mom", "fishj", "air", "local motive", and "intercontinental ballistic missile." You all know who you are.

Favorite foods

This was actually a lot of fun. I usually ask this question on forms because it's a harmless question that can have tons of answers. I didn't have any expectations for it, but given the shear number of responses, I have learned about a lot of new food with this. Even the elf agrees. Color me surprised, Stormworkers have a good taste in food. Pizza was the most popular, with 17 votes (10%) going to pizza. Burgers, soups, various pastas, and Mac n' Cheese also made the top votes. Other fun ones include:

  • оладьи

  • Popcorn shrimp

  • Chile Rellenos

  • Also your mom

  • Salted pork & Lentils

  • Currywurst

  • Shawarma

  • Megalodon fin soup

  • Red deer inner fillet with red wine sauce and creamed potatoes

  • Francesinha

  • Frikandel

  • Raclette

  • Lego

Is SWO Voice chat a good place?

No. It isn't but 25% of you thought it is. Nuh uh. Last time I was in that voice chat, it was riddled with 13 year old "rizzlers" trying to- Wait, a lot of people thought I was talking about the voice chat in Stormworks? Huh. Either way, 75% of people said no, it isn't good.

This was a pretty empty question, but like most of these, I was just trying to let people get points. Or marks. Whatever you call them. Most of these questions have no substance, they're just for the point.

Have you ever used ChatGPT to help with SWLua?

Surprisingly, far less people said yes than I thought. The rate is 26% yes, 74% no. And I'm wondering what percent of that No is just because they've never touched Stormworks Lua. Some folk are scared of Lua and programming, but we'll get into that in a minute.

What I do want to know, however, is what kind of schizophrenic results ChatGPT is giving. I've tested it, it's gotten better and can usually do very simple tasks like drawing a single square to the screen. But it often makes up functions entirely. I see people in the Discord like "why doesn't this code work" and it has made up code like targets = radar.getData(), or Deltars forbid a while true do loop. Obviously people who've never seen a line of code in their lives don't know that doesn't work, but it's a giveaway. Rant over.

How many hours do you have?

I'll just post the image.

The elf and I thought it would be funny to set the correct results to be from 2000 to 8000 hours. Originally I had it 1000 hours and up was correct. Anyway, most people have less hours than that it seems. 35% of people have less than 1000 hours. 22% have 1000-2000 hours. 37% have 2000-8000 hours (the correct answer). 5% have more than 8k. Those are insane people, with over 8k. I only have 5600. Crazy people, over 6000 hours.

Have you ever been muted in SWO?

Reddit strikes again! Turns out, if you've never been on the Stormworks Discord, you've probably never been muted in there! Although, the results are quite even, 42% yes to 58% no. Alright. That 42% (including myself and the elf) should probably read the rules.

Logic or Lua?

This is the only one where I'm distraught about the results. I love Lua! What do you mean people find it scary? What do you mean only 30% of people prefer Lua? How? I'm just kidding - mostly - I understand logic is easier to set up usually. Even excluding displays, Lua is so much easier to do complex math on, such as matrix math. Why isn't the matrix library in vehicle Lua? Same with vectors. Those should be added with a higher char limit.

I can't believe it.

Are you C4V Engineering?

Why. Would would anyone impersonate C4V of all people? This question was the elf's idea, to instantly mark anyone who said they were C4V as naughty. C4V was marked naughty, but ironically not for this reason. The handful of people who said they were C4V, I like your style.

Oh, and the presents?

Damn straight we're giving presents away. Nine possible presents: a car bomb, coal, nutcracker, christmas tree, snowball cannon, candy cane, sleigh with reindeer, a "present", and a free Project 710 Class Fast Attack Submarine, neatly wrapped with a bow!

And now for some Honorable Mentions

Shoutout to Mongoose Bubbles from Subworks and Nugget from SWO for getting the record low of 6/16 on the quiz. Both of these responses were purposefully done to score as few points as possible. They're probably not happy with such a high score.

On the opposite end of the spectrum, a potato was the only respontent to get more than 100%, getting 18/16. I'm impressed. Two people got 17 points, the technical highest possible score (I accidentally made a question worth 0 points). Three people got 16/16 points.

To everyone who put emojis somewhere in their response: I don't like you.

Shoutout to the guy from a Minecraft server I'm in for completing the quiz and having zero clue what Stormworks is. He got few points.

With 180 responses, we saw a total of 3060 answers, and I graded 900 questions. Yay!

If you missed it this year, we'll probably do it again next.

Thank you to everyone for doing this stupid project. See you next time.