Part of a series on statistics
Probability theory
Probability Axioms Determinism System Indeterminism Randomness
Probability space Sample space Event Collectively exhaustive events Elementary event Mutual exclusivity Outcome Singleton Experiment Bernoulli trial Probability distribution Bernoulli distribution Binomial distribution Exponential distribution Normal distribution Pareto distribution Poisson distribution Probability measure Random variable Bernoulli process Continuous or discrete Expected value Variance Markov chain Observed value Random walk Stochastic process
Complementary event Joint probability Marginal probability Conditional probability
Independence Conditional independence Law of total probability Law of large numbers Bayes' theorem Boole's inequality
Venn diagram Tree diagram
v t e

Independence is a fundamental notion in probability theory, as in statistics and the theory of stochastic processes. Two events are independent, statistically independent, or stochastically independent^[1] if, informally speaking, the occurrence of one does not affect the probability of occurrence of the other or, equivalently, does not affect the odds. Similarly, two random variables are independent if the realization of one does not affect the probability distribution of the other.

When dealing with collections of more than two events, two notions of independence need to be distinguished. The events are called pairwise independent if any two events in the collection are independent of each other, while mutual independence (or collective independence) of events means, informally speaking, that each event is independent of any combination of other events in the collection. A similar notion exists for collections of random variables. Mutual independence implies pairwise independence, but not the other way around. In the standard literature of probability theory, statistics, and stochastic processes, independence without further qualification usually refers to mutual independence.

Definition

For events

Two events

Two events ${\displaystyle A}$ and ${\displaystyle B}$ are independent (often written as ${\displaystyle A\perp B}$ or ${\displaystyle A\perp \!\!\!\perp B}$, where the latter symbol often is also used for conditional independence) if and only if their joint probability equals the product of their probabilities:^{[2]: p. 29 [3]: p. 10}

${\displaystyle \mathrm {P} (A\cap B)=\mathrm {P} (A)\mathrm {P} (B)}$

(Eq.1)

${\displaystyle A\cap B\neq \emptyset }$ indicates that two independent events ${\displaystyle A}$ and ${\displaystyle B}$ have common elements in their sample space so that they are not mutually exclusive (mutually exclusive iff ${\displaystyle A\cap B=\emptyset }$). Why this defines independence is made clear by rewriting with conditional probabilities ${\displaystyle P(A\mid B)={\frac {P(A\cap B)}{P(B)}}}$ as the probability at which the event ${\displaystyle A}$ occurs provided that the event ${\displaystyle B}$ has or is assumed to have occurred:

${\displaystyle \mathrm {P} (A\cap B)=\mathrm {P} (A)\mathrm {P} (B)\iff \mathrm {P} (A\mid B)={\frac {\mathrm {P} (A\cap B)}{\mathrm {P} (B)}}=\mathrm {P} (A).}$

and similarly

${\displaystyle \mathrm {P} (A\cap B)=\mathrm {P} (A)\mathrm {P} (B)\iff \mathrm {P} (B\mid A)={\frac {\mathrm {P} (A\cap B)}{\mathrm {P} (A)}}=\mathrm {P} (B).}$

Thus, the occurrence of ${\displaystyle B}$ does not affect the probability of ${\displaystyle A}$, and vice versa. In other words, ${\displaystyle A}$ and ${\displaystyle B}$ are independent to each other. Although the derived expressions may seem more intuitive, they are not the preferred definition, as the conditional probabilities may be undefined if ${\displaystyle \mathrm {P} (A)}$ or ${\displaystyle \mathrm {P} (B)}$ are 0. Furthermore, the preferred definition makes clear by symmetry that when ${\displaystyle A}$ is independent of ${\displaystyle B}$, ${\displaystyle B}$ is also independent of ${\displaystyle A}$.

Odds

Stated in terms of odds, two events are independent if and only if the odds ratio of ${\displaystyle A}$ and ${\displaystyle B}$ is unity (1). Analogously with probability, this is equivalent to the conditional odds being equal to the unconditional odds:

${\displaystyle O(A\mid B)=O(A){\text{ and }}O(B\mid A)=O(B),}$

or to the odds of one event, given the other event, being the same as the odds of the event, given the other event not occurring:

${\displaystyle }$Zdroj:https://en.wikipedia.org?pojem=Independence_(probability_theory)
Text je dostupný za podmienok Creative Commons Attribution/Share-Alike License 3.0 Unported; prípadne za ďalších podmienok. Podrobnejšie informácie nájdete na stránke Podmienky použitia.

---