The Cybernetics of Bayesian Epistemology:

I have had some good conversations recently about epistemology. Today’s post is influenced by those conversations. In today’s post, I am looking at Bayesian epistemology, something that I am very influenced by. As the readers of my blog may know, I am a student of Cybernetics. One of the main starting points in Cybernetics is that we are informationally closed. This means that information cannot enter into us from outside. This may be evident for any teachers in my viewership. You are not able to open up a student’s brain and pour information in as a commodity and then afterwards seal it back up. What happens instead is that the teacher perturbs the student and the student in turn generates meaning out of the perturbation. This would also mean that all knowledge is personal. This is something that was taught by Michael Polanyi.

How we know something is based on what we already know. The obvious question at this juncture is what about the first knowledge? Ross Ashby, one of the pioneers of Cybernetics, has written that there are two main forms of regulations. One is the gene pattern, something that was developed over generations through the evolutionary process. An example of this is the impulse of a baby to grab or to breastfeed without any training. The second is the ability to learn. The ability to learn amplifies the chance of survival of the organism. In our species, this allows us to literally reach for the celestial bodies.

If one accepts that we are informationally closed, then one has to also accept that we do not have direct access to the external reality. What we have access to is what we make sense of from experiencing the external perturbations. Cybernetics aligns with constructivism, the philosophy that we construct a reality from our experience. Heinz von Foerster, one of my favorite Cyberneticians, postulated that our nervous system as a whole is organized in such a way (organizes itself in such a way) that it computes a stable reality. All we have is what we can perceive through our perception framework. The famous philosopher, Immanuel Kant, referred to this as the noumena (the reality that we don’t have direct access to) and the phenomena (the perceived representation of the external reality). We compute a reality based on our interpretive framework. This is just a version of the reality, and each one of us computes such a reality that is unique to each one of us. The stability comes from repeat interactions with the external reality, as well as with interactions with others. We do not exist in isolation from others. The more interactions we have the more we have the chance to “calibrate” it against each other.

With this framework, one does not start from ontology, instead one starts from epistemology. Epistemology deals with the theory of knowledge and ontology deals with being (what is out there). What I can talk about is what I know about rather than what is really out there.

Bayesian epistemology is based on induction. Induction is a process of reasoning where one makes a generalization from a series of observations. For example, if all the swans you have seen so far in your life are white swans, then induction would direct you to generalize that all swans are white. Induction assumes uniformity of nature, to quote the famous Scottish philosopher David Hume. This means that you assume that the future will resemble the past. Hume pointed out that induction is faulty because no matter how many observations one makes, one cannot assume that the future will resemble the past. We seek patterns in the world, and we make generalizations from them. Hume pointed out that we do this out of habit. While many people have tried to solve the problem of induction, nobody has really solved it.

All of this discussion lays the background for Bayesian epistemology. I will not go into the math of Bayesian statistics in this post. I will provide a general explanation instead. Bayesian epistemology puts forth that probability is not a characteristic of a phenomenon, but a statement about our epistemology. The probabilities we assign are not for THE reality but for the constructed reality. It is a statement about OUR uncertainty, and not about the uncertainty associated with the phenomenon itself. The Bayesian approach requires that we start with what we know. We start with stating our prior belief, and based on the evidence presented, we will modify our belief. This is termed as the “posterior” in Bayesian terms. Today’s posterior becomes tomorrow’s prior because “what we know now” is the posterior.

Another important thing to keep in mind is that one does not assign a 0 or 100% for your belief. Even if you see a coin with 10,000 heads in a row, you should not assume that the coin is double headed. This would be jumping into the pit of the problem of induction. We can keep updating our prior based on evidence without reaching 100%.

I will write more on this topic. I wanted to start off with an introductory post and follow up with additional discussions. I will finish with some appealing points of Bayesian epistemology.

Bayesian epistemology is self-correcting – Bayesian statistics has the tendency to cut down your overconfidence or underconfidence. The new evidence presented over several iterations corrects your over or under reach into confidence.

Bayesian epistemology is observer dependent and context sensitive – As noted above, probability in Bayesian epistemology is a statement of the observer’s belief. The framework is entirely dependent on the observer and the context around sensemaking. You do not remove the observer out of the observation. In this regard, Bayesian framework is hermeneutical. We bring our biases to the equation, and we put money where our mouth is by assigning a probability value to it.

Circularity – There is an aspect of circularity in Bayesian framework in that today’s prior becomes tomorrow’s posterior as noted before.

Second Order Nature – The Bayesian framework requires that you be open to changing your beliefs. It requires you to challenge your assumptions and remain open to correcting your belief system. There is an aspect of error correction in this. You realize that you have cognitive blind spots. Knowing this allows us to better our sensemaking ability. We try to be “less wrong” than “more right”.

Conditionality – The Bayesian framework utilizes conditional probability. You see that phenomena or events do not exist in isolation. They are connected to each other and therefore require us to look at the holistic viewpoint.

Coherence not Correspondence – The use of priors forces us to use what we know. To use Willard Van Orman Quine’s phrase, we have a “web of belief”. Our priors must make sense with all the other beliefs we already have in place. This supports the coherence theory of truth instead of the realist’s favorite correspondence theory of truth. I welcome the reader to pursue this with this post.

Consistency not completeness – The idea of a consistency over completeness is quite fascinating. This is mainly due to the limitation of our nervous system to have a true representation of the reality. There is a common belief that we live with uncertainty, but our nervous system strives to provide us a stable version of reality, one that is devoid of uncertainties. This is a fascinating idea. We are able to think about this only from a second order standpoint. We are able to ponder about our cognitive blind spots because we are able to do second order cybernetics. We are able to think about thinking. We are able to put ourselves into the observed.

I will finish with an excellent quote from Albert Einstein:

“As far as the laws of mathematics refer to reality, they are not certain; as far as they are certain, they do not refer to reality”.

Please maintain social distance, wear masks and take vaccination, if able. Stay safe and always keep on learning…

In case you missed it, my last post was Error Correction of Error Correction:

One thought on “The Cybernetics of Bayesian Epistemology:

  1. Thanks again for informing me, although I’m not in the slighted disturbed.
    The first quote in my introduction to my (Dutch) book about facilitating change – on understanding reality – is from Voltaire: “La doute n’est pas une condition agréable, mais la certitude est absurde.” (in a letter to Frederic II from Prussia). Doubting is not a pleasant condition, but the certainty is absurd. He used the article “la” (the). I think he’s referring to a certain certitude, namely “your (one’s) reality”.

    “Doubt”, I still remember where I thought this thought, “is my only certainty”. In Dutch we use the word “waar” for true as well as “where”, so in my universe (reality), “true” (waar) is localized.

    As always, paradoxes (circularity) “at work”: realizing reality induces uncertain uncertainties. Using Baysian logic one gets rid of uncertainty by inducing uncertain conditions. Through thinking, one realizes one’s “uncertain” conditions, while the (your!, one’s) conditions conditioning one’s thinking.

    In thinking (and feeling) one selects a condition one judges to be more certain, based on one’s conditions. Or, the other way around, one judges one’s own (internal) condition and decides that one’s (external) conditions are un/certain. In the latter case, the cause of the internal condition is attribute on external causes, while ignoring the process of attributing one’s internal conditions. William James states – after introspection – that one fears because one is running and not that one runs out of fear (for a bear). Off course, being circular, it’s undecidable.

    I’m convinced brains – all (animal) brains – apply what we’re calling “Baysian logic” in dealing with their domains. They’re Baysian “automata”, in the classical use of Self (auto) Measuring (mata) Organisms. I’m using the word “domain” to refer to “environment”, as one’s perceiving selects (informing, making one’s difference that makes a difference) conditions – or parameters – from one’s environment, thus inducing conditioning conditions. Perceiving (feeling and intuiting, or inducing) being both a condition and conditioning feeling and thinking, while thinking and feeling (re)conditions perceiving (intuition and senses),

    In my view, as thinking using language is being conditioned by condition*s induced by one’s community (of peers), or what’s communally believed, AND a community of people strives for certainty – producing its own “reality” – to remain consistent as-a-group, any language used to reduce uncertainty should be treated as incomplete.

    To put it differently: every group of people “invents” their own language based on their condition*s (the famous, but untrue 1000 words for snow by Inuit; they actually compose words (nouns) as long as (English) sentences). This one can see as “a reality bubble”, keeping “us” – in here – safe from “them” – out there.

    The language (correct use of words by people) then becomes a condition for membership of that group. “Do you talk the talk; walk the walk?”

    I do think that with “informationally closed” one refers to the paradoxes of expressing: authority, dependency, creativity and courage (Smith and Berg, Paradoxes of Group Life). One can use it usefully, being a true fiction. I’m suddenly remembering again Kurt Vonnegut’s word ‘foma’: “Foma are harmless untruths, intended to comfort simple souls.”,_Foma_and_Granfalloons ). I’ll comment on it elsewhere.

    I’ve been fascinated by Bayes Theorem for a long time (a good friend from Leiden university introduced the concepts to me). Using Markov chains or sequences of (consequent) events (, one can prove that sequences of events consequently (I could even have used auto-matically) lead to self-organizing organisations of events within a so-called (self maintained) “Markov blankets”, ( or boundary. Perhaps “veils” would have been a better word.

    Conditioning conditions for one’s own existence and having a (semi-permeable) boundary, maintaining internal conditions independently from external is a universal – and automatic – process. One doesn’t require a maker, a creator, a director, as Markov-chains become self-making, creating, directing (or self organising). Again, our use of language – as a spin-off from toolmaking – requires a creator.

    I suppose one can show, using Clifford Algebra, a.k.a. Geometric Algebra, that structural coupling happens by itself, as time, mass, charge and space with their perceived “forces” as by magic emerge from it. ( I’m afraid (internal condition) I cannot.

    In other words: any initial sets of connected events eventually induces conditions for realizing real realities. Off course, as always, the elder (see Markov Blanket) have hidden this in the word ‘reality’: connecting a word for connection (“li”, as in li-ne, connecting two points, li-aison, etc) with the word “res” (things).

    One’s reality both emerges as one immerses as well as immerses in emergencies (pun intentionally). With our current use of language – as a tool to condition membership – we prefer reducing emergencies, seemingly uncertain, at the expense of creating (inducing) bigger emergencies in the long run.

    For instance, in The Netherlands we have been building dykes to prevent flooding. This reduced the number of events in 400 years, from once a year to once every 400 years. The consequences of this event will be 160.000 times as severe (not in the number of causalities, but in costs) as once a year. Preventing diseases by health care induces the conditions for a virus to emerge. (In my study of Biophysics, I learned that viruses “drive” evolution: they act as differentiating vectors: giving a system fresh information).

    Building on this: (third order) cyberneticians train people to become self-steering. Thanks for contributing and reading.


Leave a Reply

Fill in your details below or click an icon to log in: Logo

You are commenting using your account. Log Out /  Change )

Google photo

You are commenting using your Google account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s