TY.B.Sc[COMPUTER SCIENCE] Roll No.
1952034
Certificate
VIDYA PRASARAK MANDAL’S
R.Z. SHAH COLLEGE OF ARTS, SCIENCE &
COMMERCE
Mithagar Road,Mulund(E) - 400 081
This is to certify that Mr./Miss Ritesh Shukla Roll No.1952034 has
completed his journal in the subject of DATA SCIENCE under the program
of BSC.Computer Science Semester SEM-VI University of Mumbai during
the year 2020-2021
He has completed the prescribed practical satisfactorily.
Examination Seat No.1952014
Date: _________________
In charge Head of the Department
Sr. Title Date Signature
No
Sub:DATA SCIENCE
TY.B.Sc[COMPUTER SCIENCE] Roll No. 1952034
1 Practical of Data 7/02/2020
collection, Data curation and
management for Unstructured data
(NoSQL)
2 Practical of Data collection, Data 31/01/2020
curation and management for Large-
scale Data system (such as MongoDB)
7/02/2020
3 Practical of Principal Component
Analysis
4 Practical of Clustering 24/01/2020
5 Practical of Time-series forecasting 17/01/2020
6 Practical of Simple/Multiple Linear 24/01/2020
Regression
7/02/2020
7 Practical of Logistics Regression
14/02/2020
8 Practical of Hypothesis testing
21/02/2020
9 Practical of Analysis of Variance
28/02/2020
10 Practical of Decision Tree
INDEX
Practical No. 1 Date: 7/02/2020
Aim: Practical of Data collection, Data curation and management for Unstructured data
(NoSQL)
Sub:DATA SCIENCE
TY.B.Sc[COMPUTER SCIENCE] Roll No. 1952034
Couchdb database ---
rscript Install
couchdb first
Rscript code
install.packages('sofa')
#devtools::install_github("rop
ensci/sofa") library('sofa')
#create
connection
object x<-
Cushion$n
ew()
#to check whether
object created
x$ping()
#create
database ty
db_create(x,dbna
Sub:DATA SCIENCE
TY.B.Sc[COMPUTER SCIENCE] Roll No. 1952034
me = 'ty')
db_list(x)
#create json doc
doc1<-'{"rollno":"01","name":"ABC","GRADE":"A"}'
doc_create(x,doc1,dbname
= "ty",docid = "a_1")
doc2<-'{"rollno":"02","name":"
PQR","GRADE":"A"}'
doc_create(x,doc2,dbname = "ty",docid = "a_2")
doc3<-'{"rollno":"03","name":"xyz","GRADE":"B","REMARK":"PASS"}'
doc_create(x,doc3,dbname = "ty",docid = "a_3")
#CHANGES FEED
db_changes(x,"ty")
#search for id > null
so all docs will
display
db_query(x,dbname
= "ty",
selector = list('_id'=list('$gt'=NULL)))$docs
Sub:DATA SCIENCE
TY.B.Sc[COMPUTER SCIENCE] Roll No. 1952034
#search for students with grade is A
db_query(x,dbname = "ty",selector = list(GRADE="A"))$docs
#search for students with remark =pass
db_query(x,dbname = "ty",selector = list(REMARK="PASS"))$docs
#return only certain fields where rollno>2
db_query(x,dbname = "ty",selector =
list(rollno=list('$gt'='02')),fields=c("name","GRADE"))$docs
#convert the result of a query
into a data frame using jsonlite
library("jsonlite")
res<-db_query(x,dbname = "ty",selector =
list('_id'=list('$gt'=NULL)),fields=c("name","rollno","GRADE","REMARK"),as="json")
Sub:DATA SCIENCE
TY.B.Sc[COMPUTER SCIENCE] Roll No. 1952034
#display json doc fromJSON(res)$docs
#doc_delete(cushion,d
bname,docid)
doc_delete(x,dbname =
"ty",docid = "a_2")
doc_get(x,dbname =
"ty",docid = "a_2")
doc2<-'{"name":"Sdrink","beer":"TEST","note":"yummy","note2":"yay"}'
doc_update(x,dbname = "ty",doc=doc2,docid="a_3",rev = "3-
b1fb56db955b142c6efd3b3c52fe9e1b")
doc3<-'{"rollno":"0
1",
"name":"UZMA",
"GRADE":"A"}'
doc_update(x,dbname = "ty",doc=doc3,docid = "a_1",rev = "1-
be7c98bddf8ea7c46f4f401ff387593d")
Sub:DATA SCIENCE
TY.B.Sc[COMPUTER SCIENCE] Roll No. 1952034
Output:
Sub:DATA SCIENCE
TY.B.Sc[COMPUTER SCIENCE] Roll No. 1952034
Sub:DATA SCIENCE
TY.B.Sc[COMPUTER SCIENCE] Roll No. 1952034
Sub:DATA SCIENCE
TY.B.Sc[COMPUTER SCIENCE] Roll No. 1952034
Sub:DATA SCIENCE
TY.B.Sc[COMPUTER SCIENCE] Roll No. 1952034
Sub:DATA SCIENCE
TY.B.Sc[COMPUTER SCIENCE] Roll No. 1952034
Sub:DATA SCIENCE
TY.B.Sc[COMPUTER SCIENCE] Roll No. 1952034
Sub:DATA SCIENCE
TY.B.Sc[COMPUTER SCIENCE] Roll No. 1952034
Practical No. 2 Date: 31/01/2020
Aim: Practical of Data collection, Data curation and management for
Large-scale Data system (such as MongoDB)
MongoDB Create database
MongoDB Drop Database
MongoDB Create collection
MongoDB Drop collection
MongoDB Insert Document
MongoDB Query Document
MongoDB Update Document
Delete document in MongoDB
MongoDB Projection
limit() and skip() method in MongoDB
Sorting of Documents in MongoDB
MongoDB Indexing
Starting server with mongo or mongodb
C:\>mongo
>db
Test
Create Database in MongoDB
Once you are in the MongoDB shell, create the database in MongoDB
by typing this command:
use database_name
For example: create a database “tycs”:
> use tycs
switched to db tycs
Sub:DATA SCIENCE
TY.B.Sc[COMPUTER SCIENCE] Roll No. 1952034
create a collection user and insert a document in it.
> db.user.insert({name: "Asif", age: 20})
O/P: WriteResult({ "nInserted" : 1 })
>show dbs
admin 0.000GB
config 0.000GB
local 0.000GB
tycs 0.000GB
MongoDB Drop Database
The syntax to drop a Database is:
>db.dropDatabase()
O/P:
{ "dropped" : "Testdb", "ok" : 1 }
MongoDB Enterprise > show dbs
admin 0.000GB
config 0.000GB
local 0.000GB
tycs 0.000GB
Sub:DATA SCIENCE
TY.B.Sc[COMPUTER SCIENCE] Roll No. 1952034
O/P:
Create Collection in MongoDB
Method 1: Creating the Collection in MongoDB on the fly
MongoDB Enterprise > use tycs
switched to db tycs
MongoDB Enterprise > db.tycs.insert({name:"Asif
khan",age:21,website:"www.google.com"})
O/P:
WriteResult({ "nInserted" : 1 })
Syntax: db.collection_name.find()
MongoDB Enterprise > db.tycs.find()
o/p:
{ "_id" : ObjectId("5e410808e3755b1e06a63d1d"), "name" : "Asif khan",
"age" : 21, "website" : "www.google.com" }
show collections
MongoDB Enterprise > show collections
Sub:DATA SCIENCE
TY.B.Sc[COMPUTER SCIENCE] Roll No. 1952034
O/P:
tycs
user
Drop collection in MongoDB
SYNTAX:
db.collection_name.drop()
MongoDB Enterprise > use students
switched to db students
MongoDB Enterprise > show collections
students
teachers
tycs
user
MongoDB Enterprise > db.user.drop()
true
MongoDB Enterprise > show collections
students
teacher
tycs
MongoDB Insert Document
Syntax to insert a document into the collection:
db.collection_name.insert()
Sub:DATA SCIENCE
TY.B.Sc[COMPUTER SCIENCE] Roll No. 1952034
> db.tycs.insert(
... {
... name: "ASIF",
... age: 20,
... email: "[email protected]",
... course: [ { name: "MongoDB", duration: 7 }, { name: "Java",
duration: 30 } ]
... }
... )
O/P:
WriteResult({ "nInserted" : 1 })
Verification:
Syntax:
db.collection_name.find()
> db.tycs.find()
{ "_id" : ObjectId("5c2d37734fa204bd77e7fc1c"), "name" : "ASIF",
"age" : 20, "email" : "[email protected]", "course" : [ { "name" :
"MongoDB", "duration" : 7 }, { "name" : "Java", "duration" : 30 } ] }
MongoDB Example: Insert Multiple Documents in collection
MongoDB Enterprise > var beginners=
... [
... "studentID":1001,
... "studentName":"Asif",
... "age":20
... },
... ]
MongoDB Query Document using find() method
Querying all the documents in JSON format
MongoDB Enterprise > db.students.find().pretty()
Sub:DATA SCIENCE
TY.B.Sc[COMPUTER SCIENCE] Roll No. 1952034
{
"_id" : ObjectId("5e410f3fe3755b1e06a63d1e"),
"studentID" : 1001,
"studentName" : "Asif",
"age" : 20
}
Query Document based on the criteria
> db.students.find({StudentName : "Asif"}).pretty()
{
"_id" : ObjectId("5c281c90c23e08d1515fd9cc"),
"StudentId" : 1001,
"StudentName" : "Asif",
"age" : 20
}
Updating Document using update() method
Syntax:
db.collection_name.update(criteria, update_data)
> use tycs
switched to db tycs
> show collections
beginnersbook
students
tycs
> db.createCollection("got")
{ "ok" : 1 }
> var abc = [
... {
... "_id" : ObjectId("59bd2e73ce524b733f14dd65"),
... "name" : "Asif",
... "age" : 20
... },
... ];
Sub:DATA SCIENCE
TY.B.Sc[COMPUTER SCIENCE] Roll No. 1952034
> db.got.find().pretty()
{
"_id" : ObjectId("59bd2e73ce524b733f14dd65"),
"name" : "steve",
"age" : 20
}
To update multiple documents with the update() method:
db.got.update({"name":"Jon Snow"},
{$set:{"name":"Kit Harington"}},{multi:true})
Updating Document using save() method
Syntax:
db.collection_name.save( {_id:ObjectId(), new_document} )
To get the _id of a document, you can either type this command:
db.got.find().pretty()
> db.got.find({"name": "Asif"}).pretty()
{
"_id" : ObjectId("59bd2e73ce524b733f14dd65"),
"name" : "Asif",
"age" : 20
}
> db.got.find().pretty()
{
"_id" : ObjectId("59bd2e73ce524b733f14dd65"),
"name" : "Steve",
"age" : 20
}
MongoDB Delete Document from a Collection
Syntax of remove() method:
Sub:DATA SCIENCE
TY.B.Sc[COMPUTER SCIENCE] Roll No. 1952034
db.collection_name.remove(delete_criteria)
Delete Document using remove() method
> db.students.find().pretty()
{
"_id" : ObjectId("59bcecc7668dcce02aaa6fed"),
"StudentId" : 1001,
"StudentName" : "Steve",
"age" : 30
}
db.students.remove({"StudentId": 3333})
Output:
WriteResult({ "nRemoved" : 1 })
To verify whether the document is actually deleted. Type the following
command:
db.students.find().pretty()
It will list all the documents of students collection.
> use tycs
switched to db tycs
> db.students.find().pretty()
{
"_id" : ObjectId("5c281c90c23e08d1515fd9cc"),
"StudentId" : 1001,
"StudentName" : "Asif",
"age" : 20
}
{
"_id" : ObjectId("5c2d38934fa204bd77e7fc1d"),
"StudentId" : 1001,
"StudentName" : "Steve",
"age" : 30
}
Remove all Documents
db.collection_name.remove({})
Sub:DATA SCIENCE
TY.B.Sc[COMPUTER SCIENCE] Roll No. 1952034
MongoDB Projection
Syntax:
db.collection_name.find({},{field_key:1 or 0})
> db.students.find().pretty()
{
"_id" : ObjectId("5c281c90c23e08d1515fd9cc"),
"StudentId" : 1001,
"StudentName" : "Steve",
"age" : 20
}
> db.students.find({}, {"_id": 0, "StudentId" : 1})
{ "StudentId" : 1001 }
{ "StudentId" : 1002 }
> db.students.find({}, {"_id": 0, "StudentName" : 0, "age" : 0})
{ "StudentId" : 1001 }
{ "StudentId" : 1002 }
MongoDB – limit( ) and skip( ) method
The limit() method in MongoDB
Syntax:
db.collection_name.find().limit(number_of_documents)
db.studentdata.find({student_id : {$gt:2002}}).pretty()
db.studentdata.find({student_id : {$gt:2002}}).limit(1).pretty()
Sub:DATA SCIENCE
TY.B.Sc[COMPUTER SCIENCE] Roll No. 1952034
MongoDB Skip() Method
db.studentdata.find({student_id : {$gt:2002}}).limit(1).skip(1).pretty()
MongoDB sort() method
Sorting Documents using sort() method
Syntax of sort() method:
db.collecttion_name.find().sort({field_key:1 or -1})
1 is for ascending order and -1 is for descending order. The default
value is 1.
For example: collection studentdata contains following documents:
> db.studentdata.find().pretty()
{
"_id" : ObjectId("59bf63380be1d7770c3982af"),
"student_name" : "Steve",
"student_id" : 1001,
"student_age" :1002
}
Let’s display the student_id of all the documents in descending order:
> db.studentdata.find({}, {"student_id": 1, _id:0}).sort({"student_id": -1})
{ "student_id" : 1001 }
{ "student_id" : 1002 }
To display the student_id field of all the students in ascending order:
> db.studentdata.find({}, {"student_id": 1, _id:0}).sort({"student_id": 1})
{ "student_id" : 1001 }
{ "student_id" : 1002 }
Sub:DATA SCIENCE
TY.B.Sc[COMPUTER SCIENCE] Roll No. 1952034
MongoDB Indexing with Example
How to create index in MongoDB
db.collection_name.createIndex({field_name: 1 or -1})
The value 1 is for ascending order and -1 is for descending order.
Let’s create the index on student_name field in ascending order:
db.studentdata.createIndex({student_name: 1})
Output:
{
"createdCollectionAutomatically" : false,
"numIndexesBefore" : 1,
"numIndexesAfter" : 2,
"ok" : 1
}
MongoDB – Finding the indexes in a collection
db.collection_name.getIndexes()
> db.studentdata.getIndexes()
[
Sub:DATA SCIENCE
TY.B.Sc[COMPUTER SCIENCE] Roll No. 1952034
{
"v" : 2,
"key" : {
"_id" : 1
},
"name" : "_id_",
"ns" : "test.studentdata"
},
]
Practical No. 3 Date :7/02/2020
Aim: Practical of Principal Component Analysis
data_iris<-iris[1:4]
Cov_data<-cov(data_iris)
Eigen_data<-eigen(Cov_data)
PCA_data<-princomp(data_iris,cor="False")
Eigen_data$values
PCA_data$sdev^2
Sub:DATA SCIENCE
TY.B.Sc[COMPUTER SCIENCE] Roll No. 1952034
PCA_data$loadings[,1:4]
Eigen_data$vectors
summary(PCA_data)
biplot(PCA_data)
screeplot(PCA_data,type="lines")
model2=PCA_data$loadings[,1]
model2_scores<-as.matrix(data_iris)%*%model2
library(class)
install.packages("e1071")
library(e1071)
mod1<-naiveBayes(iris[,1:4],iris[,5])
mod2<-naiveBayes(model2_scores,iris[,5])
table(predict(mod1,iris[,1:4]),iris[,5])
table(predict(mod2,model2_scores),iris[,5])
Output:
Sub:DATA SCIENCE
TY.B.Sc[COMPUTER SCIENCE] Roll No. 1952034
Sub:DATA SCIENCE
TY.B.Sc[COMPUTER SCIENCE] Roll No. 1952034
Sub:DATA SCIENCE
TY.B.Sc[COMPUTER SCIENCE] Roll No. 1952034
Practical No. 4 Date :24/01/2020
Aim: Practical of Clustering
"K-means Clustering "
data(iris)
names(iris)
new_data<-subset(iris,select = c(-Species))
new_data
cl<-kmeans(new_data,3)
cl
data<-new_data
wss<-sapply(1:15,function(k){kmeans(data,k)$tot.withinss})
wss
plot(1:15,wss,type="b",pch=19,frame=FALSE,xlab ="Number of
clusters K",ylab = "Total within-clusters sums of squares")
library(cluster)
clusplot(new_data,cl$cluster,color=TRUE,shade=TRUE,labels=2,lines=
0)
cl$cluster
cl$centers
"agglomarative clustering "
clusters<-hclust(dist(iris[,3:4]))
plot(clusters)
clusterCut<-cutree(clusters,3)
table(clusterCut,iris$Species)
Sub:DATA SCIENCE
TY.B.Sc[COMPUTER SCIENCE] Roll No. 1952034
Output:
Sub:DATA SCIENCE
TY.B.Sc[COMPUTER SCIENCE] Roll No. 1952034
Sub:DATA SCIENCE
TY.B.Sc[COMPUTER SCIENCE] Roll No. 1952034
Sub:DATA SCIENCE
TY.B.Sc[COMPUTER SCIENCE] Roll No. 1952034
Sub:DATA SCIENCE
TY.B.Sc[COMPUTER SCIENCE] Roll No. 1952034
Practical No. 5 Date: 17/01/2020
Aim: Practical of Time-series forecasting
#consider the inbuilt data set Air Passengers
data("AirPassengers")
class(AirPassengers)
start(AirPassengers)
#to know the end of time series
end(AirPassengers)
frequency(AirPassengers)
#to know the mean median etc of the dataset
summary(AirPassengers)
#to plot the time series model
plot(AirPassengers)
abline(reg=lm(AirPassengers~time(AirPassengers)))
cycle(AirPassengers)
plot(aggregate(AirPassengers,FUN=mean))
boxplot(AirPassengers~cycle(AirPassengers))
Output:
Sub:DATA SCIENCE
TY.B.Sc[COMPUTER SCIENCE] Roll No. 1952034
Sub:DATA SCIENCE
TY.B.Sc[COMPUTER SCIENCE] Roll No. 1952034
Sub:DATA SCIENCE
TY.B.Sc[COMPUTER SCIENCE] Roll No. 1952034
Practical No. 6 Date : 24/01/2020
Aim: Practical of Simple/Multiple Linear Regression
#consider some data set
height<-
c(102,117,105,141,135,115,138,144,137,100,131,119,115,121,113)
weight<-c(61,46,62,54,60,69,51,50,46,64,48,56,64,48,59)
#lm is for Linear Regression
student<-lm(weight~height)
student
#to predict use predict command
predict(student,data.frame(height=199),interval="confidence")
#to plot the data
plot(student)
Output:
Sub:DATA SCIENCE
TY.B.Sc[COMPUTER SCIENCE] Roll No. 1952034
Sub:DATA SCIENCE
TY.B.Sc[COMPUTER SCIENCE] Roll No. 1952034
Sub:DATA SCIENCE
TY.B.Sc[COMPUTER SCIENCE] Roll No. 1952034
Practical No. 7 Date :7/02/2020
Aim: Practical of Logistics Regression
library(datasets)
ir_data<-iris
head(ir_data)
str(ir_data)
levels(ir_data$Species)
sum(is.na(ir_data))
ir_data<-ir_data[1:100,]
set.seed(100)
samp<-sample(1:100,80)
ir_test<-ir_data[samp,]
ir_ctrl<-ir_data[-samp,]
install.packages("ggplot2")
library(ggplot2)
library(ggplot2)
install.packages("GGally")
ggpairs(ir_test)
y<-ir_test$Species;
x<-ir_test$Sepal.Length
glfit<-glm(y~x,family='binomial')
summary(glfit)
newdata<-data.frame(x=ir_ctrl$Sepal.Length)
predicted_val<-predict(glfit,newdata,type="response")
prediction<-
data.frame(ir_ctrl$Sepal.Length,ir_ctrl$Species,predicted_val)
prediction
Sub:DATA SCIENCE
TY.B.Sc[COMPUTER SCIENCE] Roll No. 1952034
qplot(prediction[,1],round(prediction[,3]),col=prediction[,2],xlab='sepal.
Length',ylab='prediction using logistic Reg')
Output:
Sub:DATA SCIENCE
TY.B.Sc[COMPUTER SCIENCE] Roll No. 1952034
Sub:DATA SCIENCE
TY.B.Sc[COMPUTER SCIENCE] Roll No. 1952034
Sub:DATA SCIENCE
TY.B.Sc[COMPUTER SCIENCE] Roll No. 1952034
Practical No. 8 Date :14/02/2020
Aim: Practical of Hypothesis testing
#Entering the data
>x=c(6.2,6.6,7.1,7.4,7.6,7.9,8,8.3,8.4,8.5,8.6,8.8,8.8,9.1,9.2,9.4,9.7,9.
9,10.2,10.4,10.8,11.3,11.9)
#one-sample Hypothesis test
>t.test(x-9,alternative = "two.sided",conf.level = 0.95)
#Two-sample hypothesis test
>x=c(481,421,421,422,425,427,431,434,437,439,446,447,448,454,46
3,465)
>y=c(429,430,430,431,36,437,440,441,445,446,447)
>test2<-t.test(x,y,alternative = "two.sided",mu=0,var.equal =
F,conf.level = 0.95)
>test2
Sub:DATA SCIENCE
TY.B.Sc[COMPUTER SCIENCE] Roll No. 1952034
Output:
Interpretation of the result:
The p-value (0.2998) is greater than the significance level 5%(1-0.95)
So,we conclude that the null hypothesis that the population means
are equal is plausible.
Sub:DATA SCIENCE
TY.B.Sc[COMPUTER SCIENCE] Roll No. 1952034
Practical No.9 Date : 21/02/2020
Aim: Practical of Analysis of Variance
ftest<-read.csv(file.choose(),sep=",",header = T)
var.test(ftest$time_g1,ftest$time_g2,alternative = "two.sided")
//one way anova
names(data1)
summary(data1)
head(data1)
anv<-aov(formula=satindex~dept,data=data1)
summary(anv)
//two way anova
data2<-read.csv(file.choose(),sep=",",header=T)
names(data2)
summary(data2)
head(data2)
anv1<-aov(formula = satindex~dept+exp+dept*exp,data=data2)
summary(anv1)
Sub:DATA SCIENCE
TY.B.Sc[COMPUTER SCIENCE] Roll No. 1952034
Output:
Sub:DATA SCIENCE
TY.B.Sc[COMPUTER SCIENCE] Roll No. 1952034
Sub:DATA SCIENCE
TY.B.Sc[COMPUTER SCIENCE] Roll No. 1952034
Practical No.10 Date : 28/02/2020
Aim: Practical of Decision Tree
mydata<-data.frame(iris)
attach(mydata)
install.packages("rpart")
library(rpart)
model<-
rpart(Species~Sepal.Length+Sepal.Width+Petal.Length+Petal.Width,da
ta=mydata,method="class")
plot(model)
text(model,use.n=TRUE,all=TRUE,cex=0.8)
install.packages("tree")
library(tree)
model1<-
tree(Species~Sepal.Length+Sepal.Width+Petal.Length+Petal.Width,data
=mydata,method="class",split="gini")
plot(model1)
text(model,all=TRUE,cex=0.6)
install.packages("party")
library(party)
model2<-
ctree(Species~Sepal.Length+Sepal.Width+Petal.Length+Petal.Width,dat
a=mydata)
plot(model2)
library(tree)
mydata<-data.frame(iris)
attach(mydata)
model<-
tree(Species~Sepal.Length+Sepal.Width+Petal.Length+Petal.Width,data
=mydata,method="class",control=tree.control(nobs=150,mincut=10))
Sub:DATA SCIENCE
TY.B.Sc[COMPUTER SCIENCE] Roll No. 1952034
plot(model1)
text(model,all=TRUE,cex=0.6)
predict(model,iris)
model2<-
ctree(Species~Sepal.Length+Sepal.Width+Petal.Length+Petal.Width,dat
a=mydata,controls=ctree_control(maxdepth=2))
plot(model2)
Sub:DATA SCIENCE
TY.B.Sc[COMPUTER SCIENCE] Roll No. 1952034
Output:
Sub:DATA SCIENCE
TY.B.Sc[COMPUTER SCIENCE] Roll No. 1952034
Sub:DATA SCIENCE
TY.B.Sc[COMPUTER SCIENCE] Roll No. 1952034
Sub:DATA SCIENCE
TY.B.Sc[COMPUTER SCIENCE] Roll No. 1952034
Sub:DATA SCIENCE
TY.B.Sc[COMPUTER SCIENCE] Roll No. 1952034
Sub:DATA SCIENCE
