Thanks to visit codestin.com
Credit goes to www.scribd.com

Scribd
Upload
29 views2 pages

Sigmoid Function

The sigmoid function, or logistic function, is an S-shaped continuous function defined on all real numbers with a range of (0, 1). It is mathematically expressed as σ(x) = 1 / (1 + e^(-x)), with key properties including σ(0) = 0.5 and limits approaching 1 and 0 as x approaches infinity and negative infinity, respectively. Its derivative is given by dσ(x)/dx = σ(x)[1 - σ(x)].

Uploaded by

Ali
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
29 views2 pages

Sigmoid Function

The sigmoid function, or logistic function, is an S-shaped continuous function defined on all real numbers with a range of (0, 1). It is mathematically expressed as σ(x) = 1 / (1 + e^(-x)), with key properties including σ(0) = 0.5 and limits approaching 1 and 0 as x approaches infinity and negative infinity, respectively. Its derivative is given by dσ(x)/dx = σ(x)[1 - σ(x)].

Uploaded by

Ali
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
You are on page 1/ 2

Sigmoid functions

A sigmoid function, also called a logistic function, is an “S”-shaped continuous func-


tion with domain over all R. However, the range is only over (0, 1). It’s graph is plotted
in Figure 1.

Definition 1 The sigmoid function, also called logistic function, is a function

σ : R → (0, 1)

defined as
1
σ(x) =
1 + e−x

Figure 1: The sigmoid function.

Note that at x = 0, the sigmoid is 1


1+e0
= 1
1+1
= 0.5. Furthermore,

1
lim =1
x→∞ 1 + e−x

and
1
lim =0
x→−∞ 1 + e−x

It’s first order derivative is


dσ(x)
= σ(x)[1 − σ(x)]
dx
c Matthew Bernstein 2016 1
as proven in Theorem 1

Theorem 1
dσ(x)
= σ(x)[1 − σ(x)]
dx
Proof:
dσ(x)
= −(1 + e−x )−2 (−e−y ) by the chain rule
dx
e−y
! !
1
=
1 + e−x 1 + e−x
e−x
!
= σ(x)
1 + e−x
1 + e−x
!
1
= σ(x) −
1 + e−x 1 + e−x
= σ(x)[1 − σ(x)]

c Matthew Bernstein 2016 2

You might also like