"BITS" OF INFORMATION

If a dog bites man, it is not a news. If a man bites dog, it is a news. Anything surprise is the news and an information. If an event certainly is not going to occur then its probability of happening is 0 and it is not an information. If an event is certainly going to happen then its probability is 1 and it is also not an information.

An event which is having probability between 0 and 1 carries some information. For example: In tossing of a coin getting a head or tail is having a 50% chance or 0.5 probability. Out come of the toss is an information. In the case of rolling of dice, each outcome has 1/6 chance or 0.167 probability. Certainly the outcome of a dice is the surprise and an information.

Shannon gave a formula to calculate information content in an event based on probability.

I want to calculate the information content of coin toss and I also want to represent it in bits-binary digit format. Here probability p = 0.5 and to represent in binary, the logarithm's base must be 2.

From figure 2 we get, information content is 1 bit. That is , outcome tail can be indicated by a bit 0 and head by a bit 1.

An institution follows the following grading system.
O - outstanding
A- first class
B - second class
C- third class
F- fail

How much information is there in the grades O,A,B,C,F.
Each appearance of the grade has 1/5 chance or 0.2 probability.
From figure 2, information content in the grades is 2.3 bits. That is , slightly over 2 bits is required to encode the grades.

O- 0
A-1
B-10
C-11
F-100

Suppose we have a string like this,
"AAAACCBBBADBBAA"
Info. content in the string can be calculated using slightly modified Shannon's formula and we also get maximum number of bits required to encode it efficiently.

Initially the computer system was based on 8 bits code then we moved to 16 bits, 32 bits, and even 64 bits. More bits means more info, more pixels, more colours and more clarity.

Shannon's formula is basic to today's digital communication. It has led to efficient error-detecting and error-correcting codes. It is used in CD's, DVD's, data compression and extracting meaning from DNA sequences.

Science update: Stephen Hawking appears as hologram in Hong Kong and discusses present situation of the world.

Comments

Your heart -you do not know

Size and Location: The human heart is roughly the size of a clenched fist and is located slightly to the left of the center of the chest. Despite its relatively small size, the heart plays a crucial role in pumping blood throughout the entire body. Heartbeat Variability: The heart does not beat at a constant rate. The interval between heartbeats can vary, and this variability is considered a sign of a healthy heart. Factors such as breathing, emotions, and physical activity influence the heartbeat. Electrical Conduction: The heart's contractions are controlled by electrical impulses. The sinoatrial (SA) node, often called the "natural pacemaker," generates electrical signals that regulate the heartbeat and coordinate the pumping of blood. Blood Pumping Capacity: On average, the human heart pumps about 2,000 gallons (or 7,570 liters) of blood each day. Over a lifetime, this amounts to pumping enough blood to fill several Olympic-sized swimming pools. Heart Chambers and V...

THE WORK HORSE "="

One cannot think of a mathematical step without 'is equal to ' . It balances right hand side and left hand side. It aids simplification and manipulation of a mathematical expression. example: 2(A+B) = C 2A+2B = C 2A = C-2B A = C-2B/ 2 In an electronic calculator, the pressing of ' = " sign executes an asthmatic expression or simply calculates. In computer languages, it plays very important role. A = B When a computer looks at this expression, the value stored in the location named B is just transferred to the storage named A . After execution both A and B will have the same value an...

How does your smart phone detect motion, steps, rotation, and location?

How it works-1 An accelerometer in a smartphone is a microelectromechanical system (MEMS) device that measures acceleration and tilt. It works by detecting changes in motion by measuring the vibration or acceleration of the device. The accelerometer consists of a small mass suspended on a spring inside a sealed chamber. When the device is subjected to acceleration, the mass moves relative to the device, causing a change in capacitance that can be measured and processed by the smartphone's hardware. The accelerometer measures acceleration in three dimensions (x, y, and z) and provides data that the smartphone's software can use to determine the device's orientation, detect motion, and track changes in velocity and acceleration. The accelerometer is used for a variety of purposes in a smartphone, including screen rotation, motion tracking for games and fitness apps, and detecting the position of the device for navigation and location services. Additionally, it can be used t...

sciencecapsules

Search This Blog