Block diagrans of wive and _wiretesc_ cormmuni cafion =
— |
— | inca af FRancctucer |. j = Destinedte
7 | source, pen [ie eee
“4
IL = pena
Power _Supoly, a i
i
| dug
7 |reotifier | > |-fitter| = fei: le: Pe
equator CL
7 | i i (rel
| Ankena
E ad
¢ ~ /—Grourd, Coa ck)
{| ‘path ot Sidiciectic Substrate
‘ :
- {= Feeding Line
7 i
| Books *
TT) __Cover and 3:4 Thome
~ Elements of Ouhormahion ThearyTohn wifey g Som, 2012
pot rar c aur “Uacesy! Ss
“Sa al_pticed — 1h 2007 _ =
DRM Rett Qtnduetion to coo’ng theory”
[Gamble Univedity prac, 2006 a
D $.Un avd DT “Coretta,
"Error contol coding) 2 edition Prohive hat 2005,
Scanned with CamScanner Madulation
HEToV0 hea
WLad w=]
ad — ate = os
Scanned with CamScanner rv. of _occetraynte
" syretel So ign Mx
te associatd wit) We} Lous,
Tel dinkoywnation ee _
| Matematica ly
ria) |
pony
T Gd) = Jog |__!
Pca)
Tw) = = 105 Tull (oo 2 for bis ]
AU. =y nag Le broey
| Sdecef Cig ene
i de dnere 16 no gandorone whith meanre dhere
| is” 00 information
i 4 ' ~
* | Average information or Etro py
Dor is denated bey, H'
jr Unit ic its / symbol Cheiele Tp Kay 3,
J Entropy is a weacure of Uncertainty
ty) fadopy do und fo denote fearel of _disovder
! lo the cysten 5
He 7 i) p(si) Bits ] sembotr
= 7
wen yeas ace ke aa ace
. dhe. "4 x
Tow) = tog (1) He Joq 1
Poul] ‘. =
= ——
Scanned with CamScanner ! sh > dog (1 (ai)
7 \rtu)/
= og Catn)) Bai) 8S Jp nt
tt
= > = t(«iJ og f PO]
ead :
1
i
|
|
| Cased:
i Bs" *
|
|
|
|
|
[re
Let, Pou) = Pe) = 2
7 +
HES pt). Loa (wad)
ral Je
Ll t tag
Aah
r=
He = 1
Hew Seady to mawmum uncertainty
Scanned with CamScanner Cat? pm Pe\= o
ee Mot) = Whe) Pa at
P= dog S
Bn a mira
= ly,
pe) = pon) Erte or ta)
He og, fonts / sy moat
Scanned with CamScanner . z a
| Dyfomnatlon_ “role, _ Ls
I Te is defined as how _rnany _nurobery
Loe bith WwansmrHed or vecetvtd 9 ane. ~
“second. a
a
Grformaton bit js denoted by a En conf
| R= hits symbok
Symbes’ SECO
R= Hy tr ie yee SOUIE pnp
ete
Ate Z source ae steal with pith
j t-4 2 v
| Wah,
we Ard Jiho. rote Ye px source emit Lrabafi
| =) ‘puai}tos ft)
| i a
= =p toy t dog % teh tos
| Stet = Spt) sytoJ
| an ee A YE .
1
| R= pa=2x% [ooo 4g00 bs (xc.
Scanned with CamScanner objective mE App.ticet
_ |
- Som pig. = » Guantization > Encoeting-
tim! devety A__prdgrcm to, com pute th
[| _entyo mH Awe case dpsoete algvatana
py dp fF
I #Agor" han Disca\ ption pe 4
Find the entropy {er each follow va. a) e4
LAY tHe pla) = 0-4
AW Th pas os
he Cheading
| wo a gia) = ob
hiv pin) = 0125
iw pa) 20-8
SHS TO). PO).
14 A= selk soho.
=o — hoy (om), Pla) It
vt
= —o-1 Jogo.) + 05 Jo,0.5 — 0.2 sige = 0.25 Lege hd
vz ‘
| —o. a.
= 0.82 40+ Feige snk O2
= 9.2] av
: e_ A
: Hew
obs : !
Scanned with CamScanner a pouible. symb M4
DR degereie_ be Five Sm
. ae
ance ev. vs
CE eve ae ae ‘a :
te nesp Ca
= (6 oo a
t
A= iS eit] syentol
RE er
+ = soy
a 3 (os
om
I seco
et
ae Rr =a
_ W S28 00
"Scanned with CamScanner binary “pom, iF 0" oecurt with (pre
pb. Yq then eeu ft
[: 16) = ey (4) a bh a
j
_—+ £U= ly (a) = 0.4] 7
cal A block UW TON picture etemed: concist of
_ 525° \nee fe plcfure information pagum dak €oeh
“conperdes “of 525 picture element” Gb. each
leremente having 95% leighinets Iewels Pictures
Tare repeated bey at alt -sofseo . Calecude
average rate. Bepononafions conan! by
Inv’ set to yyewer
a
| 1 = Jag 256
| -
a=3B ed gHOY prices
; + ; T= S25 RSW KIO
a RHE 5 = G2 6RTSV dlenscse
= seat :
—_—_
Scanned with CamScanner ‘|
y on
(one a,
(our OAs Saye
yo M4
during each interval having po. pea 4
then) \V4, tag), 0lrg = Me obfain Infor Conte
ad peat lot marsege4
tinde gy WO Blasles a
veo Ww £G) &
Mulia Sel orenndion
\ Seunre emittc ane of
iat ion
e Conder 2 rantem variable ¥ bY with
Dotible outcomes of) Apfel bf. JEL, Spat
1) 16 'y' andl ‘Y! ave mutually Independant “ren
what we have the elation bet” KX &Y
____| x
pat
ees a4 “ \ PCig)=p(ade?
nae Po
© (aN) = Te }
os) Key)
= tog [PCy pou > 2)
Hemi) oCya) a coy)
Eg PO) = UR)
: AY) —
Lay = eat = 0g i= Py )
(yi)
Hence, we observed Hhak the tel iafarmalion hoving
symmetyeal in nature, 7
TK = TON
Scanned with CamScanner _choraclc .
—
. —__Tive stupes of
Binary cymenetrie sd a,
one om)
8 Rinary Aeymmetric ct
u Co ~
2
Tx e Rx
: —— Ft
Bes =
Bn binary Syummehic aT
2 (of) = p (Ho) i | ey
= = # (elo) = cl
“channel
(yr) =
—r vt we aprditiva ya.
i = py ] 9M) WY => ona need rnekyc
pray) = ee) ae i
[ YW “Yee
| ony) = 2 | Hut) 00m) |
- 1. ] Ployy) bln) - PC Ya) |
\ ia
~ ( re Ya
Dos /y) = 7 P
SS x) “| ke AL
Scanned with CamScanner _—
_ for
—_] : _ _
—] S > Yo
a
rt my eS Ny
| =P es
\
Dh We consider tnitiat phe jg0-5
E(Aeyo)= Flo a) = oq (POIW. Lage P (Be/ Ye)
Pini) Phe)
| 1 = dog (th
7 ‘ 0.5.
imho}
j ap (ato 9) zi rt
. T (alrqusirre
ae : 3A
ee ?
O od Ot a3 OF or a6 OF OH OF
Scanned with CamScanner . ~ 1 7 t a S a
SF —_
© PHOS aap
;
——
+—wa te WiTere
BCs) = Jey fcr)
ot
=0
:
He ANC OS. Mutual
The _a\comage madital
TT atiable xX BY is _glven by
Sa Py) Ph yi)
(el Jat
On
[nformertion bet? Yarden,
ETS platy) teat) }
fe (= pl) poy)
Information can nor
Note, The average musuad
be negative »
s (ivlye,
7 [Had this equal awd uly ik Yandom asjalle.
Loy’ yy! ts fm indepenel awk
“Tso: Qik L_nef cow ye do tle YY"
T
a
‘=
\
Scanned with CamScanner |
{ ‘The “Average self Information of ‘the event 7
|
KAU is deflny cu
ees =
pol : ; a
i Pree
( -
| the information of Conelitlonel entropy If
nen) = HO HX] = HY = Ht VIX)
|
TH AE
Eatrropy ¢ E -
The _Jofut _ extvony gpa sort dlyovete
valor yanmar ble. ( aM) ‘allong with a jeinh
| dustibution of pr Pah)” is depinse as
(uy) = PU Y}) dog PON YT
ak Ze Yi)-204 € 7)
bby _uAf,
Modem aticed) a
we 4) bea cal
LL
of HGS Wily) —
the “following chain ride
Scanned with CamScanner io
wt
|
ee
| _H(ry) =
TOY)= HO) +HY)— HOM) aaa
—]
Ft #h Steel |mteapretedion 4 “muttal [afeemation a
ru; yi) = et PC) _—
4 Pou) + a
“cog 2! \ethen random vanhable Xb Y teufctti Colhy
|__indep entand
roy plo)
sey = If unicalby
fina erent?
Canee > lun stu_accuranre
determi her die acturanye af
| Yeo, eye) =I
E(w YiJ= 009 [aa E ZT pat
Scanned with CamScanner