IOT COMPLETE NOTE (Module 1 2 3)
IOT COMPLETE NOTE (Module 1 2 3)
INTRODUCTION OF IOT
IoT comprises things that have unique identities and are connected to internet. By 2020 there will
be a total of 50 billion devices /things connected to internet. IoT is not limited to just connecting
things to the internet but also allow things to communicate and exchange data.
Definition:
A dynamic global n/w infrastructure with self configuring capabilities based on standard and
interoperable communication protocols where physical and virtual thing have identities,
physical attributes and virtual personalities and use intelligent interfaces, and are seamlessly
integrated into information n/w, often communicate data associated with users and their
environments.
Characteristics:
1) Dynamic & Self Adapting: IoT devices and systems may have the capability to
dynamically adapt with the changing contexts and take actions based on their operating
Eg: the surveillance system is adapting itself based on context and changing conditions.
2) Self Configuring: allowing a large number of devices to work together to provide certain
functionality.
3) Inter Operable Communication Protocols: support a number of interoperable
communication protocols ans can communicate with other devices and also with
infrastructure.
4) Unique Identity: Each IoT device has a unique identity and a unique identifier(IP
address).
5) Integrated into Information Network: that allow them to communicate and exchange
data with other devices andsystems.
Applications of IoT:
1) Home
2) Cities
3) Environment
4) Energy
5) Retail
6) Logistics
7) Agriculture
8) Industry
9) Health & LifeStyle
Physical Design Of IoT
1) Things inIoT:
The things in IoT refers to IoT devices which have unique identities and perform remote sensing,
actuating and monitoring capabilities. IoT devices can exchange dat with other connected
devices applications. It collects data from other devices and process data either locally or
remotely.
An IoT device may consist of several interfaces for communication to other devices both wired
and wireless. These includes (i) I/O interfaces for sensors, (ii) Interfaces for internet connectivity
(iii) memory and storage interfaces and (iv) audio/videointerfaces.
2) IoTProtocols:
a) Link Layer :
physical layer or medium. Local network connect to which host is attached. Hosts on the
same link exchange data packets over the link layer using link layer protocols. Link layer
determines how packets are coded and signaled by the h/w device over the medium to
which the host isattached.
Protocols:
802.3-Ethernet: IEEE802.3 is collection of wired Ethernet standards for the link layer.
Eg: 802.3 uses co-axial cable; 802.3i uses copper twisted pair connection; 802.3j uses
fiber optic connection; 802.3ae uses Ethernet overfiber.
802.11-WiFi: IEEE802.11 is a collection of wireless LAN(WLAN) communication
standards including extensive description of link layer. Eg: 802.11a operates in 5GHz
band, 802.11b and 802.11g operates in 2.4GHz band, 802.11n operates in 2.4/5GHz
band, 802.11ac operates in 5GHz band, 802.11ad operates in 60Ghzband.
802.16 - WiMax: IEEE802.16 is a collection of wireless broadband standards including
exclusive description of link layer. WiMax provide data rates from 1.5 Mb/s to 1Gb/s.
802.15.4-LR-WPAN: IEEE802.15.4 is a collection of standards for low rate wireless
personal area network(LR-WPAN). Basis for high level communication protocols such as
ZigBee. Provides data rate from 40kb/s to250kb/s.
2G/3G/4G-Mobile Communication: Data rates from 9.6kb/s(2G) to up to100Mb/s(4G).
Protocols:
IPv4: Internet Protocol version4 is used to identify the devices on a n/w using a
hierarchical addressing scheme. 32 bit address. Allows total of 2**32addresses.
IPv6: Internet Protocol version6 uses 128 bit address scheme and allows 2**128
addresses.
6LOWPAN:(IPv6overLowpowerWirelessPersonalAreaNetwork)operatesin
2.4 GHz frequency range and data transfer 250 kb/s.
C) Transport Layer: Provides end-to-end message transfer capability independent of the
underlying n/w. Set up on connection with ACK as in TCP and without ACK as in UDP.
Provides functions such as error control, segmentation, flow control and congestion control.
Protocols:
TCP: Transmission Control Protocol used by web browsers(along with HTTP and
HTTPS), email(along with SMTP, FTP). Connection oriented and stateless protocol. IP
Protocol deals with sending packets, TCP ensures reliable transmission of protocols in
order. Avoids n/w congestion and congestioncollapse.
UDP: User Datagram Protocol is connectionless protocol. Useful in time sensitive
applications, very small data units to exchange. Transaction oriented and stateless
protocol. Does not provide guaranteeddelivery.
D) Application Layer: Defines how the applications interface with lower layer protocols to
send data over the n/w. Enables process-to-process communication usingports.
Protocols:
HTTP: Hyper Text Transfer Protocol that forms foundation of WWW. Follow request-
response model Statelessprotocol.
CoAP: Constrained Application Protocol for machine-to-machine(M2M) applications
with constrained devices, constrained environment and constrained n/w. Uses client-
server architecture.
WebSocket: allows full duplex communication over a single socketconnection.
MQTT: Message Queue Telemetry Transport is light weight messaging protocol based
on publish-subscribe model. Uses client server architecture. Well suited for constrained
environment.
XMPP: Extensible Message and Presence Protocol for real time communication and
streaming XML data between network entities. Support client-server and server-server
communication.
DDS: Data Distribution Service is data centric middleware standards for device-to-device
or machine-to-machine communication. Uses publish-subscribemodel.
AMQP: Advanced Message Queuing Protocol is open application layer protocol for
business messaging. Supports both point-to-point and publish-subscribemodel.
1) IoT Functional Blocks: Provide the system the capabilities for identification,
sensing, actuation, communication andmanagement.
Device: An IoT system comprises of devices that provide sensing, actuation, monitoring
and controlfunctions.
Communication: handles the communicationfor IoTsystem.
Services: for device monitoring, device control services, data publishing services and
services for devicediscovery.
Management: Provides various functions to govern the IoTsystem.
Security: Secures IoT system and priority functions such as authentication,authorization,
message and context integrity and datasecurity.
Application: IoT application provide an interface that the users can use to control and
monitor various aspects of IoTsystem.
2) IoT CommunicationModels:
1) Request-ResponseModel:
In which the client sends request to the server and the server replies to requests. Is a
stateless communication model and each request-response pair is independent of others.
2) Publish-SubscibeModel:
Involves publishers, brokers and consumers. Publishers are source of data. Publishers send data
to the topics which are managed by the broker. Publishers are not aware of the consumers.
Consumers subscribe to the topics which are managed by the broker. When the broker receives
data for a topic from the publisher, it sends the data to all the subscribedconsumers.
3) Push-Pull Model: in which data producers push data to queues and consumers pull
data from the queues. Producers do not need to aware of the consumers. Queues help in
decoupling the message between the producers andconsumers.
4) Exclusive Pair: is bi-directional, fully duplex communication model that uses a
persistent connection between the client and server. Once connection is set up it remains
open until the client send a request to close the connection. Is a stateful communication
model and server is aware of all the open connections.
3) IoT CommunicationAPIs:
a) REST based communication APIs(Request-Response BasedModel)
b) WebSocket based Communication APIs(Exclusive PairBasedModel)
a) REST based communication APIs: Representational State Transfer(REST) is a set of
architectural principles by which we can design web services and web APIs that focus on a
tes are addressed andtransferred.
The REST architectural constraints: Fig. shows communication between client server with
REST APIs.
Client-Server: The principle behind client-server constraint is the separation of concerns.
Separation allows client and server to be independently developed and updated.
Stateless: Each request from client to server must contain all the info. Necessary to understand
the request, and cannot take advantage of any stored context on the server.
Cache-able: Cache constraint requires that the data within a response to a request be implicitly
or explicitly labeled as cache-able or non-cacheable. If a response is cache-able, then a client
cache is given the right to reuse that response data for later, equivalentrequests.
Layered System: constraints the behavior of components such that each component cannot see
beyond the immediate layer with which they are interacting.
User Interface: constraint requires that the method of communication between a client and a
server must be uniform.
Code on Demand: Servers can provide executable code or scripts for clients to execute in their
context. This constraint is the only one that is optional.
4) Communication Protocols: form the back-bone of IoT systems and enable network
connectivity and coupling toapplications.
Allow devices to exchange data overnetwork.
Define the exchange formats, data encoding addressing schemes for device and
routing of packets from source todestination.
It includes sequence control, flow control and retransmission of lostpackets.
5) Embedded Systems: is a computer system that has computer hardware and software
embedded to perform specific tasks. Embedded System range from low cost miniaturized
devices such as digital watches to devices such as digital cameras, POS terminals,
vending machines, appliancesetc.,
3) IoT Level3: system has a single node. Data is stored and analyzed in the cloud
application is cloud based as shown in fig. Level3 IoT systems are suitable for solutions
where the data involved is big and analysis requirements are computationally intensive.
An example of IoT level3 system for tracking packagehandling.
4) IoT Level4: System has multiple nodes that perform local analysis. Data is stored in the
cloud and application is cloud based as shown in fig. Level4 contains local and cloud
based observer nodes which can subscribe to and receive information collected in the
cloud from IoT devices. An example of a Level4 IoT system for NoiseMonitoring.
5) IoT Level5: System has multiple end nodes and one coordinator node as shown in fig.
The end nodes that perform sensing and/or actuation. Coordinator node collects data from
theendnodesandsendstothecloud.Dataisstoredandanalyzedinthecloudand
application is cloud based. Level5 IoT systems are suitable for solution based on wireless
sensor network, in which data involved is big and analysis requirements are
computationally intensive. An example of Level5 system for Forest Fire Detection.
6) IoT Level6: System has multiple independent end nodes that perform sensing and/or
actuation and sensed data to the cloud. Data is stored in the cloud and application is cloud
based as shown in fig. The analytics component analyses the data and stores the result in
the cloud data base. The results are visualized with cloud based application. The
centralized controller is aware of the status of all the end nodes and sends control
commands to nodes. An example of a Level6 IoT system for Weather Monitoring
System.
DOMAIN SPECIFIC IoTs
1) Home Automation:
a) Smart Lighting: helps in saving energy by adapting the lighting to the ambient
conditions and switching on/off or diming the light whenneeded.
b) Smart Appliances: make the management easier and also provide status information
to the usersremotely.
c) Intrusion Detection: use security cameras and sensors(PIR sensors and door sensors)
to detect intrusion and raise alerts. Alerts can be in the form of SMS or email sent to
theuser.
d) Smoke/Gas Detectors: Smoke detectors are installed in homes and buildings to
detect smoke that is typically an early sign of fire. Alerts raised by smoke detectors
can be in the form of signals to a fire alarm system. Gas detectors can detect the
presence of harmful gases such as CO, LPGetc.,
2) Cities:
a) Smart Parking: make the search for parking space easier and convenient for drivers.
Smart parking are powered by IoT systems that detect the no. of empty parking slots
and send information over internet to smart application backends.
b) Smart Lighting: for roads, parks and buildings can help in savingenergy.
c) Smart Roads: Equipped with sensors can provide information on driving condition,
travel time estimating and alert in case of poor driving conditions, traffic condition
andaccidents.
d) Structural Health Monitoring: uses a network of sensors to monitor the vibration
levels in the structures such as bridges and buildings.
e) Surveillance: The video feeds from surveillance cameras can be aggregated in cloud
based scalable storagesolution.
f) Emergency Response: IoT systems for fire detection, gas and water leakage
detection can help in generating alerts and minimizing their effects on the critical
infrastructures.
3) Environment:
a) Weather Monitoring: Systems collect data from a no. of sensors attached and send
the data to cloud based applications and storage back ends. The data collected in
cloud can then be analyzed and visualized by cloud basedapplications.
b) Air Pollution Monitoring: System can monitor emission of harmful gases(CO2, CO,
NO, NO2 etc.,) by factories and automobiles using gaseous and meteorological
sensors. The collected data can be analyzed to make informed decisions on pollutions
controlapproaches.
c) Noise Pollution Monitoring: Due to growing urban development, noise levels in
cities have increased and even become alarmingly high in some cities. IoT based
noise pollution monitoring systems use a no. of noise monitoring systems that are
deployed at different places in a city. The data on noise levels from the station is
collected on servers or in the cloud. The collected data is then aggregated to generate
noise maps.
d) Forest Fire Detection: Forest fire can cause damage to natural resources, property
and human life. Early detection of forest fire can help in minimizingdamage.
e) River Flood Detection: River floods can cause damage to natural and human
resources and human life. Early warnings of floods can be given by monitoring the
water level and flow rate. IoT based river flood monitoring system uses a no. of
sensor nodes that monitor the water level and flow ratesensors.
4) Energy:
a) Smart Grids: is a data communication network integrated with the electrical grids
that collects and analyze data captured in near-real-time about power transmission,
distribution and consumption. Smart grid technology provides predictive information
and recommendations to utilities, their suppliers, and their customers on how best to
manage power. By using IoT based sensing and measurement technologies, the health
of equipment and integrity of the grid can beevaluated.
b) Renewable Energy Systems: IoT based systems integrated with the transformers at
the point of interconnection measure the electrical variables and how much power is
fed into the grid. For wind energy systems, closed-loop controls can be used to
regulate the voltage at point of interconnection which coordinate wind turbine outputs
and provides powersupport.
c) Prognostics: In systems such as power grids, real-time information is collected using
specialized electrical sensors called Phasor Measurment Units(PMUs) at the
substations. The information received from PMUs must be monitored in real-time for
estimating the state of the system and for predictingfailures.
5) Retail:
a) Inventory Management: IoT systems enable remote monitoring of inventory using
data collected by RFIDreaders.
b) Smart Payments: Solutions such as contact-less payments powered by technologies
such as Near Field Communication(NFC) and Bluetooth.
c) Smart Vending Machines: Sensors in a smart vending machines monitors its
operations and send the data to cloud which can be used for predictivemaintenance.
6) Logistics:
a) Route generation & scheduling: IoT based system backed by cloud can provide first
response to the route generation queries and can be scaled upto serve a large
transportationnetwork.
b) Fleet Tracking: Use GPS to track locations of vehicles inreal-time.
c) Shipment Monitoring: IoT based shipment monitoring systems use sensors such as
temp, humidity, to monitor the conditions and send data to cloud, where it can be
analyzed to detect foodspoilage.
d) Remote Vehicle Diagnostics: Systems use on-board IoT devices for collecting data
on Vehicle operaions(speed, RPMetc.,) and status of various vehicle subsystems.
7) Agriculture:
a) Smart Irrigation: to detemine moisture amount insoil.
b) Green House Control: to improveproductivity.
8) Industry:
a) Machine diagnosis andprognosis
b) Indoor Air QualityMonitoring
An M2M area network comprises of machines( or M2M nodes) whiach have embedded
network modules for sensing, actuation and communicating various communiction
protocols can be used for M2M LAN such as ZigBee, Bluetooth, M-bus, Wireless M-Bus
etc., These protocols provide connectivity between M2M nodes within an M2M area
network.
The communication network provides connectivity to remote M2M area networks. The
communication network provides connectivity to remote M2M area network. The
communication networkcan use either wired or wireless network(IP based). While the
M2M are networks use either properietorary or non-IP baed communication protocols,
the communication network uses IP-based network. Since non-IP based protocols are
used within M2M area network, the M2M nodes within one network cannot
communicate with nodes in an externalnetwork.
To enable the communication between remote M2M are network, M2M gateways are
used.
Fig. Shows a block diagram of an M2M gateway. The communication between M2M nodes and
the M2M gateway is based on the communication protocols which are naive to the M2M are
network. M2M gateway performs protocol translations to enable Ip-connectivity for M2M are
networks. M2M gateway acts as a proxy performing translations from/to native protocols to/from
Internet Protocol(IP). With an M2M gateway, each mode in an M2M area network appears as a
virtualized node for external M2M area networks.
5) Applications
M2M data is collected in point solutions and can be accessed by on-premises
applications such as diagnosis applications, service management applications, and
on- premisis enterpriseapplications.
IoT data is collected in the cloud and can be accessed by cloud applications such
as analytics applications, enterprise applications, remote diagnosis and
management applications,etc.
1) Centralized NetworkController
With decoupled control and data planes and centralized network controller, the
network administrators can rapidly configure the network.
2) Programmable OpenAPIs
SDN architecture supports programmable open APIs for interface between the
SDN application and control layers (Northbound interface).
2) NFV Infrastructure(NFVI):
NFVI includes compute, network and storage resources that are virtualized.
Stage 2:-
The Internet gateway
The data from the sensors starts in analog form. That data needs to be aggregated and
converted into digital streams for further processing downstream. Data acquisition systems
(DAS) perform these data aggregation and conversion functions. The DAS connects to the sensor
network, aggregates outputs, and performs the analog-to-digital conversion. The Internet
gateway receives the aggregated and digitized data and routes it over Wi-Fi, wired LANs, or the
Internet, to Stage 3 systems for further processing. Stage 2 systems often sit in close proximity to
the sensors andactuators.
For example, a pump might contain a half-dozen sensors and actuators that feed data into a data
aggregation device that also digitizes the data. This device might be physically attached to the
pump. An adjacent gateway device or server would then process the data and forward it to the
Stage 3 or Stage 4 systems. Intelligent gateways can build on additional, basic gateway
functionality by adding such capabilities as analytics, malware protection, and data management
services. These systems enable the analysis of data streams in real time.
Stage 3:-
Edge IT
Once IoT data has been digitized and aggregated, it's ready to cross into the realm of IT.
However, the data may require further processing before it enters the data center. This is where
edge IT systems, which perform more analysis, come into play. Edge IT processing systems may
be located in remote offices or other edge locations, but generally these sit in the facility or
location where the sensors reside closer to the sensors, such as in a wiring closet. Because IoT
data can easily eat up network bandwidth and swamp your data center resources, it's best to have
systems at the edge capable of performing analytics as a way to lessen the burden on core IT
infrastructure. You'd also face security concerns, storage issues, and delays processing the data.
With a staged approach, you can preprocess the data, generate meaningful results, and pass only
those on. For example, rather than passing on raw vibration data for the pumps, you could
aggregate and convert the data, analyze it, and send only projections as to when each device will
fail or need service.
Stage 4:-
The data center and cloud
Data that needs more in-depth processing, and where feedback doesn't have to be immediate,
gets forwarded to physical data center or cloud-based systems, where more powerful IT systems
can analyze, manage, and securely store the data. It takes longer to get results when you wait
until data reaches Stage 4, but you can execute a more in-depth analysis, as well as combine your
sensor data with data from other sources for deeper insights. Stage 4 processing may take place
on-premises, in the cloud, or in a hybrid cloud system, but the type of processing executed in this
stage remains the same, regardless of theplatform.
Reference Architecture that describes essential building blocks as well as design choices
to deal with conflicting requirements regarding functionality, performance, deployment and
security. Interfaces should be standardised, best practices in terms of functionality and
information usage need to be provided.
The central choice of the IoT-A project was to base its work on the current state of the
art, rather than using a clean-slate approach. Due to this choice, common traits are derived to
form the base line of the Architectural Reference Model (ARM). This has the major advantage
of ensuring backward compatibility of the model and also the adoption of established, working
solutions to various aspects of the IoT. With the help of end users, organised into a stakeholders
group, new requirements for IoT have been collected and introduced in the main model building
process. This work was conducted according to established architecturemethodology.
AReference Architecture (RA) can be visualised asthe Matrix that eventuallygives birth
ideally to all concrete architectures. For establishing such a Matrix, based on a strong and
exhaustive analysis of the State of the Art, we need to envisage the superset of all possible
functionalities, mechanisms and protocols that can be used for building such concrete
architecture and to show how interconnections could take place between selected ones (as no
concrete system is likely to use all of the functional possibilities). Giving such a foundation
along with a set of design-choices, based on the characterisation of the targeted system w.r.t.
various dimensions (like distribution, security, real-time, semantics) it becomes possible for a
system architect to select the protocols, functional components, architectural options, needed to
build their IoT systems.
As any metaphoric representation, this tree does not claim to be fully consistent in its
depiction; it should therefore not be interpreted too strictly. On the one hand, the roots of this
tree are spanning across a selected set of communication protocols (6LoWPAN, Zigbee,
blossoms / leaves of the tree represent the whole set of IoT applications that can be built from
the sap (i.e., data and information) coming from the roots. The trunk of the tree is of utmost
importance here, as it represent the Architectural Reference Model (ARM). The ARM is the
combination of the Reference Model and the Reference Architecture, the set of models,
guidelines, best practices, views and perspectives that can be usedfor building fully
interoperable concrete IoT architectures and systems. In this tree, we aim at selecting a minimal
set of interoperable technologies (the roots) and proposing the potentially necessary set of
enablers or building blocks (the trunk) that enable the creation of a maximal set of interoperable
IoT systems (the leaves).
Starting with existing architectures and solutions, generic baseline requirements can be
extracted and used as an input to the design. The IoT-A ARM consists of four parts:
The vision summarises the rationale for providing an architectural reference model for
the IoT. At the same time it discusses underlying assumptions, such as motivations. Italso
discusses how the architectural reference model can be used, the methodology applied to the
architecture modelling, and the business scenarios and stakeholders addressed.
Business scenarios defined as requirements by stakeholders are the drivers of the
architecture work. With the knowledge of businesses aspirations, a holistic view of IoT
architectures can be derived.
The IoT Reference Model provides the highest abstraction level for the definition of the
IoT-A Architectural Reference Model. Itpromotes a common understanding of the IoT domain.
The description of the IoT Reference Model includes a general discourse on the IoT domain, an
IoT Domain Model as a top-level description, an IoT Information Model explaining how IoT
information is going to be modelled, and an IoT Communication Model in order to understand
specifics about communication between many heterogeneous IoT devices and the Internet as a
whole.
The IoT Reference Architecture is the reference for building compliant IoT architectures.
As such, it provides views and perspectives on different architectural aspects that are of concern
to stakeholders of the IoT. The terms view and perspectives are used according to the general
literature and standards the creation of the IoT Reference Architecture focuses on abstract sets
of mechanisms rather than concrete application architectures. To organisations, an important
aspect is the compliance of their technologies with standards and best practices, so that
interoperability across organisations isensured.
Python is a general-purpose high level programming language and suitable for providing a
solid foundation to the reader in the area of cloud computing.
Python
Benefits
Python - Setup
Datatypes
Every value in Python has a datatype. Since everything is an object in Python programming, data
types are actually classes and variables are instance (object) of these classes.
There are various data types in Python. Some of the important types are listed below.
Python Numbers
Integers, floating point numbers and complex numbers falls under Python numbers category.
They are defined as int, float and complex class in Python. We can use the type() function to
know which class a variable or a value belongs to and the isinstance() function to check if an
object belongs to a particular class.
Script.py
1. a = 5
3. a = 2.0
5. a = 1+2j
Integers can be of any length, it is only limited by the memory available. A floating point
number is accurate up to 15 decimal places. Integer and floating points are separated by decimal
points. 1 is integer, 1.0 is floating point number. Complex numbers are written in the form, x +
yj, where x is the real part and y is the imaginary part. Here are someexamples.
>>> a = 1234567890123456789
>>> a
1234567890123456789
>>> b = 0.1234567890123456789
>>> b
0.12345678901234568
>>> c = 1+2j
>>> c
(1+2j)
Python List
List is an ordered sequence of items. It is one of the most used datatype in Python and is very
flexible. All the items in a list do not need to be of the same type. Declaring a list is pretty
straight forward. Items separated by commas are enclosed within brackets [].
We can use the slicing operator [ ] to extract an item or a range of items from a list. Index starts
form 0 in Python.
Script.py
1. a = [5,10,15,20,25,30,35,40]
2. # a[2] = 15
3. print("a[2] = ", a[2])
4. # a[0:3] = [5, 10, 15]
5. print("a[0:3] = ", a[0:3])
6. # a[5:] = [30, 35, 40]
7. print("a[5:] = ", a[5:])
Python Tuple
Tuple is an ordered sequences of items same as list. The only difference is that tuples are
immutable. Tuples once created cannot be modified. Tuples are used to write-protect data and
are usually faster than list as it cannot change dynamically. It is defined within parentheses ()
where items are separated bycommas.
Script.py
t = (5,'program', 1+3j)
# t[1] = 'program'
print("t[1] = ", t[1])
# t[0:3] = (5, 'program', (1+3j))
print("t[0:3] = ", t[0:3])
# Generates error
# Tuples are immutable
t[0] = 10
Python Strings
String is sequence of Unicode characters. We can use single quotes or double quotes to represent
strings. Multi-line strings can be denoted using triple quotes, ''' or """.
Like list and tuple, slicing operator [ ] can be used with string. Strings are immutable.
Script.py
a ={5,2,3,1,4}
# printing setvariable
print("a = ", a)
# data type of variable a
print(type(a))
We can perform set operations like union, intersection on two sets. Set have unique values. They
eliminate duplicates. Since, set are unordered collection, indexing has no meaning. Hence the
slicing operator [] does not work. It is generally used when we have a huge amount of data.
Dictionaries are optimized for retrieving data. We must know the key to retrieve the value. In
Python, dictionaries are defined within braces {} with each item being a pair in the
form key:value. Key and value can be of anytype.
>>> d = {1:'value','key':2}
>>> type(d)
<class 'dict'>
We use key to retrieve the respective value. But not the other way around.
Script.py
d ={1:'value','key':2}
print(type(d))
print("d[1] = ",d[1]);
print("d['key'] = ", d['key']);
# Generates error
print("d[2] = ",d[2]);
Every value in Python has a datatype. Since everything is an object in Python programming, data
types are actually classes and variables are instance (object) of these classes. Decision making is
required when we want to execute a code only if a certain condition is satisfied.
Python if Statement
Syntax
if test expression:
statement(s)
Here, the program evaluates the test expression and will execute statement(s) only if the text
expression is True.
If the text expression is False, the statement(s) is not executed. In Python, the body of
the if statement is indicated by the indentation. Body starts with an indentation and the first
unindented line marks the end. Python interprets non-zero values as True. None and 0 are
interpreted as False.
num = 3
if num > 0:
print(num, "is a positive number.")
print("This is always printed.")
num = -1
if num >0:
print(num, "is a positive number.")
print("This is also always printed.")
In the above example, num > 0 is the test expression. The body of if is executed only if this
evaluates to True.
When variable num is equal to 3, test expression is true and body inside body of if is executed. If
variable num is equal to -1, test expression is false and body inside body of if is skipped.
The print() statement falls outside of the if block (unindented). Hence, it is executed regardless
of the testexpression.
Syntax
if test expression:
Body of if
else:
Body of else
The if..else statement evaluates test expression and will execute body of if only when test
condition is True.
If the condition is False, body of else is executed. Indentation is used to separate the blocks.
Example of if...else
If num is equal to -5, the test expression is false and body of else is executed and body of if is
skipped.
If num is equal to 0, the test expression is true and body of if is executed and body of else is
skipped.
Python if...elif...else Statement
Syntax
if test expression:
Body of if
elif test expression:
Body of elif
else:
Body of else
The elif is short for else if. It allows us to check for multiple expressions. If the condition
for if is False, it checks the condition of the next elif block and so on. If all the conditions
are False, body of else is executed. Only one block among the several if...elif...else blocks is
executed according to the condition. The if block can have only one else block. But it can have
multiple elifblocks.
Flowchart of if...elif...else
Example of if...elif...else
# In this program,
# we check if the number is positive or
# negative or zero and
# display an appropriate message
num = 3.4
# Try these two variations as well:
# num = 0
# num = -4.5
if num > 0:
print("Positive number")
elif num == 0:
print("Zero")
else:
print("Negative number")
We can have a if...elif...else statement inside another if...elif...else statement. This is called
nesting in computer programming. Any number of these statements can be nested inside one
another. Indentation is the only way to figure out the level of nesting. This can get confusing, so
must be avoided if we can.
Output 1
Enter a number: 5
Positive number
Output 2
Enter a number: -1
Negative number
Output 3
Enter a number: 0
Zero
Syntax
# Program to find the sum of all numbers stored in a list
# List of numbers
numbers = [6, 5, 3, 8, 4, 2, 5, 4, 11]
# variable to store the sum
sum = 0
The while loop in Python is used to iterate over a block of code as long as the test expression (condition)
is true. We generally use this loop when we don't know beforehand, the number of times to iterate.
while test_expression:
Body of while
In while loop, test expression is checked first. The body of the loop is entered only if the test_expression
evaluates to True. After one iteration, the test expression is checked again. This process continues until
the test_expression evaluates to False. In Python, the body of the while loop is determined through
indentation. Body starts with indentation and the first unindented line marks the end. Python interprets
any non-zero value as True. None and 0 are interpreted asFalse.
In the above program, the test expression will be True as long as our counter variable i is less than or
equal to n (10 in ourprogram).
We need to increase the value of counter variable in the body of the loop. This is very important (and
mostly forgotten). Failing to do so will result in an infinite loop (never ending loop).
Finally the result is displayed.
Python Modules
A file containing a set of functions you want to include in the application is called Module.
Create a Module
To create a module just save the code you want in a file with the file extension .py:
Example
Use a Module
Now we can use the module we just created, by using the import statement:
Example
Import the module named mymodule, and call the greeting function:
import mymodule
mymodule.greeting("Jonathan")
Note: When using a function from a module, use the syntax: module_name.function_name.
Variables in Module
The module can contain functions, as already described, but also variables of all types(arrays,
dictionaries, objects etc):
Example
Example
Import the module named mymodule, and access the person1 dictionary:
import mymodule
a = mymodule.person1["age"]
print(a)
Naming a Module
You can name the module file whatever you like, but it must have the file extension .py
Re-naming a Module
You can create an alias when you import a module, by using the as keyword:
Example
Built-in Modules
There are several built-in modules in Python, which you can import whenever you like.
Example
There is a built-in function to list all the function names (or variable names) in a module. The
dir() function:
Example
Note: The dir() function can be used on all modules, also the ones you create yourself.
You can choose to import only parts from a module, by using the from keyword.
Example
The module named mymodule has one function and one dictionary:
def greeting(name):
print("Hello, " + name)
person1 = {"name": "John", "age": 36, "country": "Norway"}
Example
Note: When importing using the from keyword, do not use the module name when referring to
elements in the module. Example: person1["age"], not mymodule.person1["age"].
Packages
We don't usually store all of our files in our computer in the same location. We use a well-
organized hierarchy of directories for easier access. Similar files are kept in the same directory,
for example, we may keep all the songs in the "music" directory. Analogous to this, Python has
packages for directories and modules for files. As our application program grows larger in size
with a lot of modules, we place similar modules in one package and different modules in
different packages. This makes a project (program) easy to manage and conceptuallyclear.
Similar, as a directory can contain sub-directories and files, a Python package can have sub-
packages and modules. A directory must contain a file namedinit.py in order for Python to
consider it as a package. This file can be left empty but we generally place the initialization code
for that package in this file. Here is an example. Suppose we are developing a game, one possible
organization of packages and modules could be as shown in the figure below.
We can import modules from packages using the dot (.) operator. For example, if want to import
the start module in the above example, it is done as follows.
import Game.Level.start
Now if this module contains a function named select_difficulty(), we must use the full name to
reference it.
Game.Level.start.select_difficulty(2)
If this construct seems lengthy, we can import the module without the package prefix as follows.
from Game.Level import start
start.select_difficulty(2)
Yet another way of importing just the required function (or class or variable) form a module
within a package would be as follows.
select_difficulty(2)
Although easier, this method is not recommended. Using the full namespace avoids confusion
and prevents two same identifier names from colliding. While importing packages, Python looks
in the list of directories defined in sys.path, similar as for module search path.
Files
File is a named location on disk to store related information. It is used to permanently store data
in a non-volatile memory (e.g. hard disk). Since, random access memory (RAM) is volatile
which loses its data when computer is turned off, we use files for future use of the data. When
we want to read from or write to a file we need to open it first. When we are done, it needs to be
closed, so that resources that are tied with the file are freed. Hence, in Python, a file operation
takes place in the followingorder.
1. Open afile
2. Read or write (perform operation)
3. Close thefile
Python has a built-in function open() to open a file. This function returns a file object, also called
a handle, as it is used to read or modify the file accordingly.
>>> f=open("test.txt") # open file in currentdirectory
>>> f = open("C:/Python33/README.txt") # specifying full path
We can specify the mode while opening a file. In mode, we specify whether we want to read 'r',
write 'w' or append 'a' to the file. We also specify if we want to open the file in text mode or
binary mode. The default is reading in text mode. In this mode, we get strings when reading from
the file. On the other hand, binary mode returns bytes and this is the mode to be used when
dealing with non-text files like image or exe files.
Unlike other languages, the character 'a' does not imply the number 97 until it is encoded using
ASCII (or other equivalent encodings). Moreover, the default encoding is platform dependent. In
windows, it is 'cp1252' but 'utf-8' in Linux. So, we must not also rely on the default encoding or
else our code will behave differently in different platforms. Hence, when working with files in
text mode, it is highly recommended to specify the encoding type.
When we are done with operations to the file, we need to properly close the file. Closing a file
will free up the resources that were tied with the file and is done using Python close() method.
Python has a garbage collector to clean up unreferenced objects but, we must not rely on it to
close the file.
f = open("test.txt",encoding = 'utf-8')
# perform file operations
f.close()
This method is not entirely safe. If an exception occurs when we are performing some operation
with the file, the code exits without closing the file.
try:
f = open("test.txt",encoding = 'utf-8')
# perform file operations
finally:
f.close()
This way, we are guaranteed that the file is properly closed even if an exception is raised,
causing program flow to stop. The best way to do this is using the with statement. This ensures
that the file is closed when the block inside with is exited. We don't need to explicitly call the
close() method. It is doneinternally.
In order to write into a file in Python, we need to open it in write 'w', append 'a' or exclusive
creation 'x' mode. We need to be careful with the 'w' mode as it will overwrite into the file if it
already exists. All previous data are erased. Writing a string or sequence of bytes (for binary
files) is done using write() method. This method returns the number of characters written to the
file.
To read a file in Python, we must open the file in reading mode. There are various methods
available for this purpose. We can use the read(size) method to read in size number of data. If
size parameter is not specified, it reads and returns up to the end of the file.
We can read a file line-by-line using a for loop. This is both efficient and fast.
Moreover, the print() end parameter to avoid two newlines when printing. Alternately, we can
use readline() method to read individual lines of a file. This method reads a file till the newline,
including the newlinecharacter.
>>> f.readline()
'This is my first file\n'
>>> f.readline()
'This file\n'
>>> f.readline()
'contains three lines\n'
>>> f.readline()
''
Lastly, the readlines() method returns a list of remaining lines of the entire file. All these reading
method return empty values when end of file (EOF) is reached.
>>> f.readlines()
There are various methods available with the file object. Some of them have been used in above
examples. Here is the complete list of methods in text mode with a brief description.
Method Description
close() Close an open file. It has no effect if the file is already closed.
detach() Separate the underlying binary buffer from the TextIOBase and return it.
fileno() Return an integer number (file descriptor) of the file.
flush() Flush the write buffer of the file stream.
isatty() Return True if the file stream is interactive.
read(n) Read at most n characters form the file. Reads till end of file if it is negative or None.
readable() Returns True if the file stream can be read from.
readline(n=-1) Read and return one line from the file. Reads in at most n bytes if specified.
readlines(n=-1) Read and return a list of lines from the file. Reads in at most n bytes/characters if specified.
seek(offset,from=SE Change the file position to offset bytes, in reference to from (start, current, end).
EK_SET)
seekable() Returns True if the file stream supports random access.
tell() Returns the current file location.
truncate(size=None) Resize the file stream to size bytes. If size is not specified, resize to current location.
writable() Returns True if the file stream can be written to.
write(s) Write string s to the file and return the number of characters written.
writelines(lines) Write a list of lines to the file.
Method Description
close() Close an open file. It has no effect if the file is already closed.
detach() Separate the underlying binary buffer from the TextIOBase and returnit.
fileno()Return an integer number (file descriptor) of thefile.
flush() Flush the write buffer of the file stream.
isatty() Return True if the file stream is interactive.
read(n) Read at most n characters form the file. Reads till end of file if it is negative or None.
readable() Returns True if the file stream can be readfrom.
readline(n=-1) Read and return one line from the file. Reads in at most n bytes if specified.
readlines(n=-1) Read and return a list of lines from the file. Reads in at most n
bytes/characters ifspecified.
seek(offset,from=SEEK_SET) Change the file position to offset bytes, in reference to from
(start, current,end).
seekable() Returns True if the file stream supports randomaccess.
tell() Returns the current filelocation.
truncate(size=None) Resize the file stream to size bytes. If size is not specified, resize to
currentlocation.
writable() Returns True if the file stream can be writtento.
write(s) Write string s to the file and return the number of characterswritten.
writelines(lines) Write a list of lines to thefile.
UNIT IV
IoT PHYSICAL DEVICES AND ENDPOINTS
IoT Device
can send/receive data (including user data) over a network (e.g., smart phone, smartTV,
computer, refrigerator, car, etc.).
IoT devices are connected to the Internet and send information about themselves or about their
surroundings (e.g. information sensed by the connected sensors) over a network (to other devices
or servers/storage) or allow actuation upon the physical entities/environment around them
remotely.
can do. Raspberry Pi also allows interfacing sensors and actuators through the general purpose
I/O pins. Since Raspberry Pi runs Linux operating system, it supports Python "out of the box".
Raspberry Pi is a low-cost mini-computer with the physical size of a credit card. Raspberry Pi
and can perform almost all tasks that a normal desktop computer
can do. Raspberry Pi also allows interfacing sensors and actuators through the general purpose
I/O pins. Since Raspberry Pi runs Linux operating system, it supports Python "out of the box".
Raspberry Pi
Linux on Raspberry Pi
Raspberry Pi GPIO
Raspberry Pi Interfaces
1. Serial: The serial interface on Raspberry Pi has receive (Rx) and transmit (Tx) pins for
communication with serialperipherals.
2. SPI: Serial Peripheral Interface (SPI) is a synchronous serial data protocol used for
communicating with one or more peripheraldevices.
3. I2C: The I2C interface pins on Raspberry Pi allow you to connect hardware modules.
I2C interface allows synchronous data transfer with just two pins - SDA (data line) and
SCL (clockline).
GPIO.setmode(GPIO.BCM)
#LEDPin
GPIO.setup(18,GPIO.OUT)
state=false
deftoggleLED(pin):
GPIO.output(pin,state)
whileTrue:
try:
if (GPIO.input(25) ==True):
toggleLED(pin)
sleep(.01)
exceptKeyboardInterrupt:
exit()
Other Devices
1. pcDuino
2. BeagleBoneBlack
3. Cubieboard
UNIT V