Tag Archives: knowledge

Entropy on the brain

It was the worst of times, it was the worst of times.  Again.  That’s the things about things.  They fall apart, always have, always will, it’s in their nature.’  They are the opening three lines of Ali Smith’s novel ‘Autumn’.  Ali Smith doesn’t mention entropy but that’s what she is describing.

My first-year lecture course has progressed from the first law of thermodynamics to the second law; and so, I have been stretching the students’ brains by talking about entropy.  It’s a favourite topic of mine but many people find it difficult.  Entropy can be described as the level of disorder present in a system or the environment.  Ludwig Boltzmann derived his famous equation, S=k ln W, which can be found on his gravestone – he died in 1906.  S is entropy, k is a constant of proportionality named after Boltzmann, and W is the number of arrangements in which a system can be arranged without changing its energy content (ln means natural logarithm).  So, the more arrangements that are possible then the larger is the entropy.

By now the neurons in your brain should be firing away nicely with a good level of synchronicity (see my post entitled ‘Digital hive mind‘ on November 30th, 2016 and ‘Is the world comprehensible?‘ on March 15th, 2017).  In other words, groups of neurons should be showing electrical activity that is in phase with other groups to form large networks.  Some scientists believe that the size of the network was indicative of the level of your consciousness.  However, scientists in Toronto led by Jose Luis Perez-Velazquez, have suggested that it is not the size of the network that is linked to consciousness but the number of ways that a particular degree of connectivity can be achieved.  This begins to sound like the entropy of your neurons.

In 1948 Claude Shannon, an American electrical engineer, stated that ‘information must be considered as a negative term in the entropy of the system; in short, information is negentropy‘. We can extend this idea to the concept that the entropy associated with information becomes lower as it is arranged, or ordered, into knowledge frameworks, e.g. laws and principles, that allow us to explain phenomena or behaviour.

Perhaps these ideas about entropy of information and neurons are connected; because when you have mastered a knowledge framework for a topic, such as the laws of thermodynamics, you need to deploy a small number of neurons to understand new information associated with that topic.  However, when you are presented with unfamiliar situations then you need to fire multiple networks of neurons and try out millions of ways of connecting them, in order to understand the unfamiliar data being supplied by your senses.

For diverse posts on entropy see: ‘Entropy in poetry‘ on June 1st, 2016; ‘Entropy management for bees and flights‘ on November 5th, 2014; and ‘More on white dwarfs and existentialism‘ on November 16th, 2016.


Ali Smith, Autumn, Penguin Books, 2017

Consciousness is tied to ‘entropy’, say researchers, Physics World, October 16th, 2016.

Handscombe RD & Patterson EA, The Entropy Vector: Connecting Science and Business, Singapore: World Scientific Publishing, 2004.


Blinded by the light

It has become a habit during our summer vacation to read the novels short-listed for Bailey’s Women’s Prize for Fiction.  Unusually this year, we were not only unanimous in our choice of the best novel but we also agreed with the judges and selected the ‘The Power‘ by Naomi Alderman.  In another of the books, Do Not Say We Have Nothing by Madeleine Thien, a Chinese composer called Sparrow thinks ‘about the quality of sunshine, that is, how daylight wipes away the stars and planets, making them invisible to human eyes, might daylight be a form of blindness? Could it be that sound was also be a form of deafness? If so, what was silence?’.  I felt some resonance between these thoughts and John Hull’s writings on blindness and my earlier blog posting on ‘Listening with your eyes shut‘ [on May 31st, 2017].  In our everyday life, we are bombarded with sounds from people living around us, from traffic and from devices in our homes and places of work.  We rarely experience silence; however, when we do, perhaps on holiday staying in a remote rural location, then a whole new set of sounds becomes apparent: waves breaking on the shore in the distance, the field mouse rooting around under the floorboards, or the noises of cattle enjoying the lush grass in the field next door.  Okay, so you have to be in the right place to hear these sounds of nature but you also need silence otherwise you are deaf to them, as Sparrow suggests.

The same is true for knowledge and understanding because our minds have finite capacity [see my post entitled ‘Silence is golden‘ on January 14th, 2014].  When you are bombarded with information and data it is easy to become overwhelmed and unable to structure the information in way that makes it useful or meaningful.  In our connected society, information has become like white noise, or daylight obscuring the stars and planets.  Information is blinding us to knowledge and understanding.  We need to aggressively filter the information flow in order to gain insight and knowledge.  We should switch off the digital devices, which bombard us with information constantly, to leave our minds free for conceptual and creative thinking because that’s one of the few tasks in which we can outperform the smartest machine [see my post entitled ‘Smart machines‘ on February 26th, 2014].

In a similar vein see: ‘Ideas from a balanced mind‘ on August 24th, 2016 and ‘Thinking out-of-the-skull‘ on March 18th, 2015.