Requesting your help on designing a survey

[Gautama]

I started a poll a couple days ago asking people which brands of screwdrivers they'd had failures with. It got a lot of activity and some interesting results, however the polls on this forum simply aren't sophisticated enough to get any meaningful data. I'm thinking it might be interesting to put together a more comprehensive survey using SurveyMonkey, but I'd like to get some suggestions on what to ask, or whether I should even bother.

I'm thinking this first survey should be limited to screwdrivers. If we get good participation, we could do additional surveys for other tool types. I'm looking for suggestions on what questions to ask, as well as which brands should be included. The goal is to try and get a handle (ha!) on which brands are reliable, how people are using the tools, and how people use warranties or whether they play a factor in purchasing.

I've never taken a statistics class, so if you think I'm missing some key concepts I wouldn't be surprised.

Thanks for your input!

 

[ssdave]

The problems with this type of survey are multifold:
1) There is no control of the conditions the tools were used under. You're comparing heavy users in abusive conditions to once in a lifetime users.
2) There is room for bias for someone who wants to sandbag the survey, and not any way to identify that bias.
3) There is no comparison of the number of failures to the number of incidents of ownership; there should be some relationship; for instance # of failures per 1000 users.
4) The selection of the participants is not random, you get someone who is interested in the subject that responds. This puts a bias on the survey of those that have an axe to grind are most likely to reply.
5) Evaluation of failure is subjective. Failure to one may be ordinary wear to others. A consistent definition of failure is needed, as well as an objective way to determine if failure has occurred.

 

[Gautama]

I appreciate the input so far. Since this isn't going to be used for anything other than "huh, that's interesting," I'm not terribly concerned about some of the niggling stuff. For example, we don't need to ask someone why they are satisfied with a screwdriver, as this is intended solely to find out about failures. But the concerns about sandbagging and multiple product lines are certainly valid.

 

[bdelmar2]

One of the largest factors in tool reliability is how it get used.

I very seldom break any tools at all and I work with them daily.

Others will destroy tools regularly, along with misplacing and losing them.

A coworker recently purchased a set of nice snap on screwdrivers. In a few months, less than 6 for sure, 4 at the outside, they look like they would if I owned them for 10 years or longer.

The cheap harbor freight green/orange handled screwdrivers I've had for about 4 years are in better shape, and I use them far more than those snapons get used.

I have a set of mayhew striking screwdrivers I've had for about 6 months, I use two of them daily for rebuilding transmissions. I use them for pretty much everything you should not use a screwdriver for. I hammer on them, I twist and pry with them, I don't believe I've ever used one as a screwdriver and they are still fine.

I don't really know what exactly is at work here, its either bothering to think about how you are using the tool as you use it, or not understanding some basic mechanical principles regarding force and leverage, or perhaps both.

I guess my point is if someone doesn't know how to use (or misuse) a tool properly, just don't care, or expect just because it was an expensive tool it should take it, they are going to have way different reliability than someone who uses the tool as it should be used or at least within reasonable application given the tools design.

I will also guarantee you that if you ask anybody on this forum if they know how to use a screwdriver they will assure you they do.

 

[lazer50]

Yes ive worked in industry/electrical.heavy equipment.trucks autos.several harsh environments.for 35 years and my screwdrivers dont fail or i dont damage them.i have several brands but that doesn't matter.a guy like me or the previous post who use tools properly could show completely opposite answers of someone using the same high quality tools.and some guys would be biased you'll have that too.the only survey i can think of that i would be interested in as lets say an inquisitive new buyer would be what brand have i purchased or set that i feel was the best value.

 

[d.mcfarland]

The sample group is never going to be "all inclusive". Most people here have a long tool history in not the friendliest environments and most have a beater set of tools so they don't ruin their good ones doing things they know have the possibility to damage a tool.