Unit 1 BI & Data Science
Unit 1 BI & Data Science
Introduction
The word analytics has come into the foreground in last decade or so. The increase of the
internet and information technology has made analytics very relevant in the current age.
Analytics is a field which combines data, information technology, statistical analysis,
quantitative methods and computer-based models into one.
This all are combined to provide decision makers all the possible scenarios to make a well
thought and researched decision. The computer-based model ensures that decision makers are
able to see performance of decision under various scenarios.
Meaning
Business analytics (BA) is a set of disciplines and technologies for solving business problems
using data analysis, statistical models and other quantitative methods. It involves an iterative,
methodical exploration of an organization's data, with an emphasis on statistical analysis, to
drive decision-making.
forecasting future business needs, performance, and industry trends with predictive
modelling; and
Definition
Business analytics (BA) refers to the skills, technologies, and practices for
continuous iterative exploration and investigation of past business performance to
gain insight and drive business planning. Business analytics focuses on developing
new insights and understanding of business performance based on data and statistical
methods.
Business analytics has been existence since very long time and has evolved with
availability of newer and better technologies. It has its roots in operations research,
which was extensively used during World War II.
Analytics have been used in business since the management exercises were put into
place by Frederick Winslow Taylor in the late 19th century.
Henry Ford measured the time of each component in his newly established assembly
line. But analytics began to command more attention in the late 1960s when
computers were used in decision support systems.
Since then, analytics have changed and formed with the development of enterprise
resource planning (ERP) systems, data warehouses, and a large number of other
software tools and processes.
In later years the business analytics have exploded with the introduction of computers. This
change has brought analytics to a whole new level and has brought about endless
possibilities. As far as analytics has come in history, and what the current field of analytics is
today, many people would never think that analytics started in the early 1900s with Mr. Ford
himself.
As the economies started developing and companies became more and more competitive,
management science evolved into business intelligence, decision support systems and into PC
software.
Business analytics has a wide range of application and usages. It can be used for
descriptive analysis in which data is utilized to understand past and present situation. This
kind of descriptive analysis is used to asses’ current market position of the company and
effectiveness of previous business decision.
It is used for predictive analysis, which is typical used to asses’ previous business
performance.
Business analytics is also used for prescriptive analysis, which is utilized to formulate
optimization techniques for stronger business performance.
Before any data analysis takes place, BA starts with several foundational processes:
Determine the business goal of the analysis.
Select an analysis methodology.
Get business data to support the analysis, often from various systems and sources.
Cleanse and integrate data into a single repository, such as a data warehouse or data
mart.
For starters, business analytics is the tool your company needs to make accurate decisions.
These decisions are likely to impact your entire organization as they help you to improve
profitability, increase market share, and provide a greater return to potential shareholders.
While some companies are unsure what to do with large amounts of data, business analytics
works to combine this data with actionable insights to improve the decisions you make as a
company
Essentially, the four main ways business analytics is important, no matter the industry, are:
Improves performance by giving your business a clear picture of what is and isn’t
working
Provides faster and more accurate decisions
Minimizes risks as it helps a business make the right choices regarding consumer
behaviour, trends, and performance
Inspires change and innovation by answering questions about the consumer.
Business analytics uses data from three sources for construction of the business
model. It uses business data such as annual reports, financial ratios, marketing
research, etc. It uses the database which contains various computer files and
information coming from data analysis.
Apart from having applications in various arenas, following are the benefits of Business
Analytics and its impact on business –
Moreover, any technology is subject to its own set of problems and challenges. Following are
the challenges in implementing business analytics in an organization.
Now business analytics is becoming a tool that can influence the outcome of customer
interactions. When a specific customer type is considering a purchase, an analytics-
enabled enterprise can modify the sales pitch to appeal to that consumer. This means
the storage space for all that data must react extremely fast to provide the necessary
data in real-time.
Application
In healthcare, business analysis can be used to operate and manage clinical information
systems. It can transform medical data from a bewildering array of analytical methods into
useful information. Data analysis can also be used to generate contemporary reporting
systems which include the patient's latest key indicators, historical trends and reference
values.
Decision analytics: supports human decisions with visual analytics that the user
models to reflect reasoning.
Descriptive analytics: gains insight from historical data with reporting,
scorecards, clustering etc.
Predictive analytics: employs predictive modelling using statistical and machine
learning techniques
Prescriptive analytics: recommends decisions using optimization, simulation, etc.
Behavioural analytics
Cohort analysis
Competitor analysis
Cyber analytics
Enterprise optimization
Financial services analytics
Fraud analytics
Health care analytics
Key Performance Indicators (KPI's)
Marketing analytics
Pricing analytics
Retail sales analytics
Risk & Credit analytics
Supply chain analytics
Talent analytics
Telecommunications
Transportation analytics
Customer Journey Analytics
Market Basket Analysis
The aim of business analytics is data and reporting—examining past business performance
and forecasting future business performance. On the other hand, the business analysis
focuses on functions and processes—determining business requirements and suggesting
solutions.
Business analysis is the practice of assisting firms in resolving their technical difficulties by
understanding, defining, and solving those issues.
The activities that are carried out while performing Business Analysis:
Company analysis: Business analysis aims at figuring out the requirements of a firm
in general and its strategic direction and determining the initiatives that will enable
the business to address those strategic goals.
Requirements planning and management: It focuses on planning the requirements
of the development process, identifying what the top priority is for execution, and
managing the changes.
Requirements elicitation: It outlines techniques for collecting needs from relevant
members of the project team.
Requirements analysis and documentation: It explains how to establish and define
the needs in detail to allow them to be effectively carried out by the team.
Requirements communication: Business analysis explains methods to help
stakeholders have a shared understanding of the needs and how they will be carried
out.
Solution assessment and validation: It also explains how a business analyst can
execute a suggested solution, how to support the execution of a solution, and how to
evaluate possible flaws in the implementation.
Finance
Marketing
HR
CRM
Manufacturing
Banking and Credit Cards
Most people believe that business analysis and analytics are the same, but they are not! The
primary differences between business analysis and business analytics:
Business Analysis
Business Analytics
Business analysis and business analytics have some commonalities. They both:
Business analysis is a practice of identifying business requirements and figuring out solutions
to specific business problems. This has a heavy overlap with the analysis of business needs to
function normally and to enhance how they function. Sometimes, the solutions include a
system’s development feature. It can also incorporate business change, process enhancement
or strategic planning, and policy improvement.
On the contrary, business analytics is all about the group of tools, techniques, and skills that
help the investigation of previous business performance. It also aids to gain insights into
future performance. In general, business analytics aims mostly at data and statistical analysis.
Categorization of Analytical Models
It can help identify strengths and weaknesses and provides an insight into customer
behaviour too. This helps in forming strategies that can be developed in the area of
targeted marketing.
2. Diagnostic Analytics
This type of Analytics helps shift focus from past performance to the current events and
determine which factors are influencing trends. To uncover the root cause of events,
techniques such as data discovery, data mining and drill-down are employed. Diagnostic
analytics makes use of probabilities, and likelihoods to understand why events may occur.
Techniques such as sensitivity analysis and training algorithms are employed for
classification and regression.
3. Predictive Analytics
This type of Analytics is used to forecast the possibility of a future event with the help of
statistical models and ML techniques. It builds on the result of descriptive analytics to
devise models to extrapolate the likelihood of items. To run predictive analysis, Machine
Learning experts are employed. They can achieve a higher level of accuracy than by
business intelligence alone.
One of the most common applications is sentiment analysis. Here, existing data collected
from social media and is used to provide a comprehensive picture of an users opinion.
This data is analysed to predict their sentiment (positive, neutral or negative).
4. Prescriptive Analytics
Going a step beyond predictive analytics, it provides recommendations for the next best
action to be taken. It suggests all favourable outcomes according to a specific course of
action and also recommends the specific actions needed to deliver the most desired result.
It mainly relies on two things, a strong feedback system and a constant iterative analysis.
It learns the relation between actions and their outcomes. One common use of this type of
analytics is to create recommendation systems.
Business Analytics Tools
Business Analytics tools help analysts to perform the tasks at hand and generate reports
which may be easy for a layman to understand. These tools can be obtained from open
source platforms, and enable business analysts to manage their insights in a
comprehensive manner. They tend to be flexible and user-friendly. Various business
analytics tools and techniques like.
Python is very flexible and can also be used in web scripting. It is mainly
applied when there is a need for integrating the data analyzed with a web
application or the statistics is to be used in a database production. The I Python
Notebook facilitates and makes it easy to work with Python and data. One can
share notebooks with other people without necessarily telling them to install
anything which reduces code organizing overhead
SAS The tool has a user-friendly GUI and can churn through terabytes of data
with ease. It comes with an extensive documentation and tutorial base which
can help early learners get started seamlessly.
R is open source software and is completely free to use making it easier for
individual professionals or students starting out to learn. Graphical capabilities
or data visualization is the strongest forte of R with R having access to
packages like GGPlot, RGIS, Lattice, and GGVIS among others which provide
superior graphical competency.
Tableau is the most popular and advanced data visualization tool in the
market. Story-telling and presenting data insights in a comprehensive way has
become one of the trademarks of a competent business analyst Tableau is a
great platform to develop customized visualizations in no time, thanks to the
drop and drag features.
Python, R, SAS, Excel, and Tableau have all got their unique places when it comes to
usage.
Data Scientist vs. Data Engineer vs. Data Analyst
1. Data scientists use their advanced statistical skills to help improve the models the data
engineers implement and to put proper statistical rigour on the data discovery and analysis the
customer is asking for.
Companies extract data to analyze and gain insights about various trends and
practices. In order to do so, they employ specialized data scientists who possess
knowledge of statistical tools and programming skills. Moreover, a data scientist
possesses knowledge of machine learning algorithms.
However, Data Science is not a singular field. It is a quantitative field that shares its
background with math, statistics and computer programming. With the help of data
science, industries are qualified to make careful data-driven decisions.
These algorithms are responsible for predicting future events. Therefore, data science
can be thought of as an ocean that includes all the data operations like data extraction,
data processing, data analysis and data prediction to gain necessary insights.
For becoming a Data Scientist, you must have the following key skills –
Should be proficient with Math and Statistics.
Should be able to handle structured & unstructured information.
In-depth knowledge of tools like R, Python and SAS.
Well versed in various machine learning algorithms.
Have knowledge of SQL(Structured Query Language) and NoSQL(Non Structured
Query Language or not only SQL)
Must be familiar with Big Data tools.
2. A Data Engineer is a person who specializes in preparing data for analytical usage. Data
Engineering also involves the development of platforms and architectures for data processing.
In other words, a data engineer develops the foundation for various data operations. A
Data Engineer is responsible for designing the format for data scientists and analysts
to work on.
Data Engineers have to work with both structured and unstructured data. Therefore,
they need expertise in SQL and NoSQL databases both. Data Engineers allow data
scientists to carry out their data operations.
Data Engineers have to deal with Big Data where they engage in numerous operations
like data cleaning, management, transformation, data deduplication etc.
A data analyst does not directly participate in the decision-making process; rather, he
helps indirectly through providing static insights about company performance. A data
engineer is not responsible for decision making. And, a data scientist participates in
the active decision-making process that affects the course of the company.
A data analyst uses static modelling techniques that summarize the data through
descriptive analysis. On the other hand, a data engineer is responsible for
the development and maintenance of data pipelines. A data scientist uses dynamic
techniques like Machine learning to gain insights about the future.
Knowledge of machine learning is not important for data analysts. However, this is
mandatory for data scientists. A data engineer need not require the knowledge of
machine learning but he is required to have the knowledge of core computing
concepts like programming and algorithms to build robust data systems.
A data analyst only has to deal with structured data. However, both data scientists
and data engineers deal with unstructured data as well.
Data analyst and data scientists are both required to be proficient in data visualization.
However, this is not required in the case of a data engineer.
Both data scientists and analysts need not have knowledge of application
development and working of the APIs. However, this is the most essential
requirement for a data engineer.
In order to become a Data Analyst, you must possess the following skills –
Should possess the strong mathematical aptitude
Should be well versed with Excel, Oracle, and SQL.
Possession of problem-solving attitude.
Proficient in the communication of results to the team.
Should have a strong suite of analytical skills.
Business Analyst
Business analysts use data to form business insights and recommend changes in businesses and
other organizations. Business analysts can identify issues in virtually any part of an
organization, including IT processes, organizational structures, or staff development.
As businesses seek to increase efficiency and reduce costs, business analytics has become an
important component of their operations. Let’s take a closer look at what business analysts do
and what it takes to get a job in business analysis.
Business analysts identify business areas that can be improved to increase efficiency and
strengthen business processes. They often work closely with others throughout the business
hierarchy to communicate their findings and help implement changes.
Tasks and duties can include:
Identifying and prioritizing the organization's functional and technical needs and
requirements
Using SQL and Excel to analyze large data sets
Compiling charts, tables, and other elements of data visualization
Creating financial models to support business decisions
Understanding business strategies, goals, and requirements
Planning enterprise architecture (the structure of a business)
Forecasting, budgeting, and performing both variance analysis and financial analysis
Business analyst skills
Technical skills: These skills include stakeholder management, data modeling and
knowledge of IT.
Analytical skills: Business analysts have to analyze large amounts of data and other
business processes to form ideas and fix problems.
Communication: These professionals must communicate their ideas in an expressive
way that is easy for the receiver to understand.
Problem-solving: It is a business analyst’s primary responsibility to come up with
solutions to an organization’s problems.
Research skills: Thorough research must be conducted about new processes and
software to present results that are effective.
Business analyst responsibilities
Analyzing and evaluating the current business processes a company has and
identifying areas of improvement
Researching and reviewing up-to-date business processes and new IT advancements
to make systems more modern
Presenting ideas and findings in meetings
Training and coaching staff members
Creating initiatives depending on the business’s requirements and needs
Developing projects and monitoring project performance
Collaborating with users and stakeholders
Working closely with senior management, partners, clients and technicians
Types of Data
Qualitative vs. Quantitative Data
1. Quantitative data
Quantitative data seems to be the easiest to explain. It answers key questions such as
“how many, “how much” and “how often”.
Quantitative data can be expressed as a number or can be quantified. Simply put, it
can be measured by numerical variables.
Quantitative data are easily amenable to statistical manipulation and can be
represented by a wide variety of statistical types of graphs and charts such as line, bar
graph, scatter plot, and etc.
Examples of quantitative data:
Scores on tests and exams e.g. 85, 67, 90 and etc.
The weight of a person or a subject.
Your shoe size.
The temperature in a room.
2. Qualitative data
Qualitative data can’t be expressed as a number and can’t be measured. Qualitative
data consist of words, pictures, and symbols, not numbers.
Qualitative data is also called categorical data because the information can be sorted
by category, not by number.
Qualitative data can answer questions such as “how this has happened” or and “why
this has happened”.
Examples of qualitative data:
Colors e.g. the color of the sea
Your favorite holiday destination such as Hawaii, New Zealand and etc.
Names as John, Patricia..
Ethnicity such as American Indian, Asian, etc.
1. BA LEVELS
There are four levels that a business analyst in an organization comprises of:
Strategic management: This is the analysis level, where a business analyst evaluates
and calculates the strategic where about if a company. This is one of the most critical
levels because unless the evaluation is done on the point, none of the further steps can
work appropriately.
Analysis of business model: This level has to do with evaluating policies that are
currently being employed by the company. This not only enables us to implement
what’s new but also helps in checking the previous ones.
Designing the process: Like an artist creates his imagination, business analysts do
that with their skills. The step includes modelling the business processes, which
comes out to be designing and modelling.
Analysis of technology: Technical systems need a thorough analysis too. This is
something that, if not taken care of, leads to severe consequences.
The key business analyst roles and responsibilities:
What does a business needs: As a business analyst, it is his key responsibility to
understand what stakeholders need and pass these requirements to the developers, and
also give on the developer’s expectations to the stakeholders. A business analyst’s
skill for this responsibility is the communication skills that can impress everyone
across. While he transfers the information, he is the one who needs to put these in
such words that make a difference. This responsibility is no doubt tome taking
because he needs to listen and execute, which might seem easy, but only a skilled
professional can handle all this.
Conducting meetings with developing team and stakeholders: Business analysts
are supposed to coordinate with both stakeholders and the development team
whenever a new feature or update is added to a project. This may vary from project to
project. This facilitates the collection of client feedback and the resolution of issues
encountered by the development team when implementing new features.
The business analyst role is to understand and explain the new feature updates to
clients and take feedback for further development. Based on client feedback, Business
Analyst instructs the development team to make amendments or continue as is. At
times, the client requests an additional feature be added to a project, and the BA must
determine whether or not it is feasible, and then assign resources if necessary to
implement it.
System possibilities: A business analyst might be considered one among those
working in the software team, but their key responsibility Is not what the team does.
He has to ensure that he figures out what a project needs. He is the one who leads the
path to the goals. He might be the one who dreams of targets, but he is also the one
who knows how to make those dreams a reality. Looking for the opportunities and
grabbing them before they go is what a business analyst is good at.
Present the company: He can be called the face of a business. A business analyst is
responsible for putting a business’s thoughts and goals in front of the stakeholders. In
short, he is the one who needs to impress the stakeholders with his presentation skills
and the skill to present what the person on the other side is looking for and not what
the company has in store for them.
Present the details: A project brings with itself hundreds of minute details that might
be left unseen. A business analyst is the one who is responsible for elaborating the
project with the tiniest of the loopholes or hidden secrets. This is considered the most
crucial role of a business analyst because unless the details are put across the
stakeholders, they won’t take an interest, and unless they show the part, the project is
likely to take a pause.
Implementation of the project: After going through all the steps mentioned above,
the next and the most important role of a business analyst in agile is to implement
whatever has been planned. Execution is not easy unless the previous steps have been
taken care of in a systemized fashion.
Functional and non-functional requirements of a business: As an organization, the
main goal is to receive an end product that is productive and gives a company a long
time. The role of business analyst in it company is to take care of the business’s
functional aspect, which includes the steps and ways to ensure the working of the
project. Sideways he is also supposed to take care of the non-functional that comprise
how a project or a business is supposed to work.
Testing: The role of a business analyst is way longer than expected. Once the product
is prepared, the next step is to test it among the users to know it’s working capacity
and quality. The Business Analyst tests the prototype/interface by involving some
clients and recording their experiences with the model that has been developed,
according to the role description. Based on their feedback, Business Analyst intends
to make some changes to the model that will make it even better. They conduct UAT
(user acceptance test) to determine whether or not the prototype meets the
requirements of the project under consideration.
Decision making and problem-solving: The responsibilities of business
analyst range from developing the required documents to making decisions in the
most stringent circumstances, job role of business analyst is to do it all. Moreover, a
business analyst is expected to be the one who tackles things most easily and calmly
because he should also be good at problem-solving, even if that’s related to the
stakeholders, employees, or the clients.
Maintenance: Like they say that care is as essential as building something new. No
matter how much human resources, energy, or finds you spend on a project, if the
maintenance part is not taken care of properly or is neglected, it tends to spoil the
entire hard work put across. What is the role of a business analyst here? Is it just
limited to the maintenance of the clients or sales; it also has to ensure that the quality
and the promised products are maintained throughout.
Building a team: Everyone is born with varied skills. As a business analyst, the
business analyst’s responsibility is to make the team with people possessing different
skills required for the project. Not only the hiring but retaining them is as essential. A
well united and skilled team can do wonders. The things that are required in a great
section inside co combination, structuring, and skills. A good team tends to take the
company to the heights of success.
Presentation and Documentation of the Final Project: After the business project is
completed, the Business Analyst must document the details of the project and share
the project’s findings with the client. In most cases, BA roles and
responsibilities include preparing reports and presenting the results of a project to
key stakeholders and clients. During building the project, they must also record all of
the lessons learned and challenges they encountered in a concise form. This step aids
the business analyst in making better decisions in the future.
CONCLUSION
A business analyst might be another position in an organization but its roles and
responsibilities play a vital role in an organization’s success. While he needs to be a good
orator, he should possess the quality of bringing people closers to his team and across. His
roles are not limited to a specific step in project management. He is required one overstep till
the end. From the initial stages of evaluation to the maintenance, a company needs a business
analyst’s skill.