# Why women's MX test posts are hidden at first: blinding against observer bias

**URL:** <https://pheromonetalk.com/t/why-womens-mx-test-posts-are-hidden-at-first-blinding-against-observer-bias/63558>\
**Category:** MX Test Results\
**Created:** [December 31, 2014, 12:04am UTC](https://pheromonetalk.com/t/why-womens-mx-test-posts-are-hidden-at-first-blinding-against-observer-bias/63558 "2014-12-31T00:04:52Z")\
**Posts on this page:** 2\
**Page:** 1

<div class="post-metadata">

**Author:** ![Androtics](https://avatars.discourse-cdn.com/v4/letter/a/e9c0ed/32.png) [@Androtics](https://pheromonetalk.com/u/Androtics)\
**Post date:** [December 31, 2014, 12:04am UTC](https://pheromonetalk.com/t/why-womens-mx-test-posts-are-hidden-at-first-blinding-against-observer-bias/63558/1 "2014-12-31T00:04:52Z")

</div>

**Why Are My Posts Initially Hidden?**

The OFFICIAL MX forum is designed to initially blind all MX feedback for NEW formulas, to keep data clean of tainted results. Every post made to this forum will be hidden at first.

_Here’s why:_

Organisms do weird things when they detect observation. (See: [Hawthorne Effect/Observer Bias](http://en.wikipedia.org/wiki/Observer_effect_%28physics%29))The **observer-expectancy effect** , in science, is a cognitive bias that occurs when a researcher expects a given result and therefore unconsciously manipulates an experiment or misinterprets data in order to find it. Because it can skew the results of experiments (especially on human subjects), double-blind methodology is used to eliminate the effect.  
**Source** :[Experimenter effect - Psychology Wiki](http://psychology.wikia.com/wiki/Observer-expectancy_effect)

https://www.youtube.com/embed/LA02PuuJgDM?feature=oembed&wmode=opaque  
Instead of linking you to very dry and boring powerpoint explanations about “Observer Bias” that the scientists of youtube seem to think we want (but will likely put you to sleep), here I link Molly Kae, who has more pizazz and F-words to keep you engaged.

Soliciting clean feedback is a tricky thing to design. We don’t want to describe too much what we think an MX will do, 1. because nature never works like man expects it to, and 2. even if it did, leaking too much initial information causes demand characteristics to crop up.

“Demand Characteristics” is the psychology term for the subtle cues which make participants aware of what the experimenter is looking for. Subconsciously, when demand characteristics are detectable, participants pander to the experimenter (dirtying the data) instead of reporting actual feedback. This skews the data and gives a distorted view of what a mix does.In research - particularly psychology - **demand characteristics** refers to an experimental artifact where participants form an interpretation of the experiment’s purpose and _unconsciously change their behavior to fit that interpretation_. Pioneering research was conducted on demand characteristics by Martin Orne. Typically, they are considered an extraneous variable, exerting an effect on behavior other than that intended by the experimenter.  
**Source** : [Demand characteristics - Wikipedia, the free encyclopedia](http://en.wikipedia.org/wiki/Demand_effect)  
**Avoiding Normative Social Influence, AKA: “Collusion”:**

Forums, while great for building community, are _terrible_ for collecting honest data. In the 50s, there was a prof named [Solomon Asch](http://en.wikipedia.org/wiki/Asch_conformity_experiments), who laid the groundwork for testing how people’s decisions are influenced by their social surroundings. In general, he concluded people act all sorts of weird ways when in a group with other people.

Check out this 5 minute video:

[![](https://us1.discourse-cdn.com/flex016/uploads/pheromonetalk/original/2X/b/b7ef82b3706a68f9c6e8e9933407776a6d8fb1d2.jpeg "Asch Conformity Experiment") ](https://www.youtube.com/watch?v=TYIh4MkcfJA)

Don’t be that dork who reports “Effect X”, even though you haven’t directly observed it! Seeking public agreement and consensus during data collection is the opposite of science. In order to make products you’ll enjoy, we need the best raw, unbiased feedback you can give, untainted by the opinions of others.

- 

Because of these human quirks, when you get a new MX, you agree to the following: \*

- A minimum 3 week black out period (embargo) on speaking **publicly** , or even to others, about what the mixes do. This embargo may be extended until at least 25% (1/4th) of purchasers provide some type feedback, either to the Official MX Forum or privately to us.
- **You must give feedback in some form.** Either in our (initially blinded) forum, or privately to [Feedback@androtics.com](mailto:Feedback@androtics.com) (Always enter MX# in Subject Line). New experimental mixes are never for sale to the general public or people who won’t give feedback.
- Don’t worry about our feelings or “expectations” when reporting on these or any other experimental mixes. All we expect from you is your best efforts at reporting what actually happens when using the test mixes. Think “reality”, not appeasement.
- Please respect these needs of data collection, or you’ll lose access to our test mixes.
- Any MX pack may contain a placebo or control in order to increase data quality. We have new experimental MX prices low enough so this shouldn’t matter (and in fact, we often lose money on early runs). If you’re not OK with this, then please don’t participate in this trial.
- Until 3 weeks after an MX’s First Release post, or until at least 25% (1/4th) of purchasers have given feedback via the blinded forum or our special email address, you are only allowed to say on public parts of the forum say that you ordered or have received the mix. Please don’t even say if you like them.

---

<div class="post-metadata">

**Author:** ![LadyScientist](https://avatars.discourse-cdn.com/v4/letter/l/c57346/32.png) [@LadyScientist](https://pheromonetalk.com/u/LadyScientist)\
**Post date:** [January 12, 2015, 2:08am UTC](https://pheromonetalk.com/t/why-womens-mx-test-posts-are-hidden-at-first-blinding-against-observer-bias/63558/2 "2015-01-12T02:08:20Z")

</div>

Just a suggestion: maybe link ppl to this page when they receive them? I would have followed the rules had I known about it - was out of the country/away from internet for a while and never want to disrespect the process .
