AI-Enhanced
Research
Proposal Webinar
(Basic Research)
School Research Committee
November 19, 2023
1:00 PM – 4:00 PM
Batasan Hills National High School
Definition of Basic Research
Exploration of
No Immediate Application Contributions to Knowledge
Fundamental Principles
• Basic research is primarily concerned • Basic research is not driven by • The primary outcome of basic research is the
with exploring and uncovering the immediate applications or commercial generation of new knowledge and the
fundamental principles and laws that interests. Instead, it lays the foundation advancement of understanding. It contributes
govern various natural phenomena. for future innovations by providing a to the body of literature, expands our
solid theoretical framework and a knowledge base, and fosters intellectual
deeper comprehension of the subject growth within the scientific community.
matter. Basic research often serves as
the building blocks for applied research
and technological advancements in the
long run.
Contents
Non-BERF Research Crafting AI – Assisted
and Innovation SRC Quality Basic Research
SY 2023-2024 Control Proposal
1
Non-BERF Research
and Innovation 2023-2024
Division Memorandum No. 949 s. 2023
September 11, 2023
DepEd MATATAG Agenda
Process Flow of the Submission and
Evaluation of Research/ Innovation Proposals
In a nutshell
3-4 weeks before
the deadline
Step 1 Step 2 Step 3 Step 4
The researcher initiates SRC Evaluation SGOD-Planning and The proposal shall
the process by submitting - For Feedback/ Revision Research Section proceed to the next stage
their research or - Revise and Resubmit Handling of development.
innovation proposal to the - For indorsement - Approved/ not Approved
SRC.
SRC Quality Control
2
Corrigendum/
Addendum DM
949 s. 2023
Division Memorandum No. 135,
series 2023
Plagiarism Awareness: Promoting Academic Integrity
November 25, 2023 (Afternoon)
Quantitative Data Analysis: Insights Webinar
May 11, 2023
Quantitative Data Analysis: Insights Webinar
May 18, 2023
EthiCARE: Nurturing Research Integrity
December 2, 2023
Action Research Basic Research
3
Let’s Do It!
Crafting AI – Assisted
Basic Research Proposal
5 SIMPLE STEPS
Identify a Research Review Existing Formulate a
Question or Topic Literature Hypothesis or
Research Objective
Data Processing
Design the Research
Methodology
Identify a Research Question or Topic
Identify an Area of Interest
Example: This should be a broad field or subject you're curious about. In elementary mathematics, this could be fundamental math
skills among students.
Narrow Down to a Specific Aspect
Example: Within your area of interest, pinpoint a more specific aspect that you want to explore. For instance, you might be interested
in the extent of lack of fundamental skills in arithmetic among third-grade students.
Formulate a Question
Example: Turn your specific aspect into a researchable question. An example question might be: "What is the level of proficiency in
basic arithmetic among third-grade students in a particular school or district?"
Ensure the Question is Researchable
Example: The question should be clear, focused, and answerable through research. In our example, the question targets a specific
skill (basic arithmetic) in a defined group (third-grade students) and is answerable through methods like tests or surveys.
Consider the Relevance and Impact
Example: Think about why this question is important. In the example, understanding the proficiency level in basic arithmetic can help
in developing targeted educational strategies to improve math skills in early education.
Problem: What is the extent of inter-rater and intra-rater agreement in the evaluation of
master teachers' performance during online classroom observation, and how do various
factors such as the evaluation criteria, experience of the raters, and the specific online
teaching context influence the agreement levels?
Problem: What is the extent of inter-rater and intra-rater
agreement in the evaluation of master teachers' performance
during online classroom observation, and how do various
factors such as the evaluation criteria, experience of the
raters, and the specific online teaching context influence the
agreement levels?
Review Existing Literature:
Gap could be the potential variability in how different and untrained raters (master
teachers) evaluate teachers during online classroom observation.
Variability in perceptions and judgments among raters can impact the validity and
reliability of the evaluation process.
Formulate a Hypothesis or Research Objective:
The objective of this study is to investigate and quantify the extent of variability in how
different raters evaluate master teachers during online classroom observation to assess its
impact on the validity and reliability of the evaluation process.
Design the Research Methodology:
Study Design – Correlational Research
Participants – Master teachers
Data Collection - Rater Evaluations (Quantitative)
Design the Research Methodology:
Study Design – Correlational Research
Participants – Master teachers
Data Collection - Rater Evaluations (Quantitative)
• Raters will evaluate the online classroom performance of 5
teachers using a standardized evaluation form (VCOT).
• Multiple raters will independently evaluate the same teacher's
performance to measure inter-rater agreement.
• The same rater will evaluate the same teacher's performance on
multiple occasions (3 weeks) to measure intra-rater agreement.
Design the Research Methodology:
Data Analysis (Quantitative)
• Inter-rater agreement will be assessed using statistical measures namely,
intraclass correlation coefficients (ICC).
• Intra-rater agreement will be examined using test-retest reliability measures.
• Descriptive statistics will be used to summarize quantitative data.
Ethical Considerations:
• Ethical approval will be obtained from relevant ethics committees or institutions.
• Informed consent will be obtained from all participants, ensuring their privacy
and confidentiality.
Data Processing:
Findings:
Given their familiarity and confidence in giving accurate ratings, the intraclass
correlation coefficient (ICC) reveals a low degree of inter- and intra-rater agreement.
Few raters are significantly influenced by personal and technical factors. This was
amplified by the influence of their bias/errors, especially leniency. Giving an
accurate performance rating to educators by raters is an opportunity for them to
continuously and proficiently improve in their chosen profession. Departing from
this goal will compromise both the educator’s teaching quality and the learners’
education. Therefore, there is a need for planned and intensive rater training to
improve inter- and intra-rater agreement and mitigate bias/error effects, promoting
fair and balanced performance evaluation among teachers.
Review Existing Literature
A literature review is a comprehensive summary and
analysis of existing research and literature relevant
to a specific topic or research question.
Formulate a Hypothesis or
Research Objective
Identify a Gap or Unanswered Question: From your literature review, pinpoint a
specific gap or an area that has not been fully explored. This will give you direction
for your research.
Design the Research Methodology
A. SAMPLING
• Discuss who the respondents/participants and how are they chosen (sampling method) for the study.
• Provide the total number of participants/respondents and their profile or conditions if there is any.
B. DATA COLLECTION
• Discuss the research design to be employed and why it is the most appropriate.
• Discuss the research tool/instruments to be used
- Definition (purpose of the instrument – information it collects)
- Inclusions (number of items, coverage, type (survey questionnaire, Likert scale, etc.)
- Validity and reliability
C. ETHICAL ISSUES
• Ethical considerations involved in the process.
A. SAMPLING
PURPOSIVE SAMPLING
Design the Research Methodology
A. SAMPLING
• Discuss who the respondents/participants and how are they chosen (sampling method) for the study.
• Provide the total number of participants/respondents and their profile or conditions if there is any.
B. DATA COLLECTION
• Discuss the research design to be employed and why it is the most appropriate.
• Discuss the research tool/instruments to be used
- Definition (purpose of the instrument – information it collects)
- Inclusions (number of items, coverage, type (survey questionnaire, Likert scale, etc.)
- Validity and reliability
C. ETHICAL ISSUES
• Ethical considerations involved in the process.
Research Design
is a framework or blueprint for conducting a research project. It outlines the
procedures for every step of the research process, from selecting a topic
to analyzing data.
Quantitative
Qualitative
Qualitative
Design the Research Methodology
A. SAMPLING
• Discuss who the respondents/participants and how are they chosen (sampling method) for the study.
• Provide the total number of participants/respondents and their profile or conditions if there is any.
B. DATA COLLECTION
• Discuss the research design to be employed and why it is the most appropriate.
• Discuss the research tool/instruments to be used
- Definition (purpose of the instrument – information it collects)
- Inclusions (number of items, coverage, type (survey questionnaire, Likert scale, etc.)
- Validity and reliability
C. ETHICAL ISSUES
• Ethical considerations involved in the process.
Design the Research Methodology
A. SAMPLING
• Discuss who the respondents/participants and how are they chosen (sampling method) for the study.
• Provide the total number of participants/respondents and their profile or conditions if there is any.
B. DATA COLLECTION
• Discuss the research design to be employed and why it is the most appropriate.
• Discuss the research tool/instruments to be used
- Definition (purpose of the instrument – information it collects)
- Inclusions (number of items, coverage, type (survey questionnaire, Likert scale, etc.)
- Validity and reliability
C. ETHICAL ISSUES
• Ethical considerations involved in the process.
Data Processing
Statistical treatment in research refers to the various methods and techniques used to
analyze and interpret data collected during a study. This process involves applying
statistical procedures to organize, summarize, and make sense of the data, ultimately to
test hypotheses and answer research questions.
Qualitative analysis in research refers to the examination of non-numeric data, often seeking
to understand complex phenomena through detailed descriptions and interpretations. This
type of analysis is primarily used in social sciences, humanities, and other fields where
understanding the depth, complexity, and context of the subject matter is crucial.
Descriptive Statistics
Parametric
- Mean
- Standard Deviation
Non-Parametric
- Median
- Interquartile Range
Inferential
Correlational
Parametric
- Pearson Correlation
- Partial/Semi – Partial Correlation
Non-Parametric Agreement
- Spearman Rho - ICC
- Kendall’s Rank Correlation - Kappa
- Sommer’s d - Kendall’s coefficient of concordance
- Gamma
Inferential
Comparative
Parametric
- Independent t – test
- ANOVA (One-way, Two-way, Factoria, Repeated Measure, Mixed)
- ANCOVA
- Paired t-test
Non-Parametric
- Mann-Whitney
- Kruskal-Wallis H Test
- Friedman Test
- McNemar’s Test
- Cochran’s Q
Inferential
Prediction
Parametric
- Linear Regression Analysis
- Multivariate Analysis
Non-Parametric
- Dichotomous Regression Analysis
- Nominal Regression Analysis
- Ordinal Regression Analysis
- Loglinear Regression Analysis
Research Title is a brief, clear summary that encapsulates the
focus and key elements of a study or paper.
ChatGPT Prompt
Create a basic research title from the following information:
1. Purpose of the research - The research aims to examine the agreement among
raters evaluating master teachers during online classroom observation, focusing
on inter-rater and intra-rater consistency. It seeks to improve the reliability and
validity of the evaluation process.
2. Scope of the research - The research will focus on evaluating master teachers in
online classrooms, investigating factors influencing agreement, and considering
implications for professional development.
3. Method used to study the problem - The research uses quantitative research.
Addendum
Research Title:
Rating the Raters: Examining the Inter- and Intra-Rater Agreement among
Master Teachers’ Evaluation During Online Classroom Observation
Objective:
• The objective is to assess and understand the agreement levels among
raters evaluating teachers during online classroom observation, both
between different raters (inter-rater agreement) and within the same rater
over time (intra-rater agreement).
• Additionally, the research aims to investigate factors influencing variability in
ratings and evaluate the reliability and validity of the evaluation process.
I. Introduction and Rationale
introduces the topic, states the research problem, outlines
objectives, explains significance, defines scope, and previews
the paper's organization.
Introduction is the opening section of a research paper, thesis, or any
scholarly work. Its primary purpose is to provide readers with an
overview of the research topic, context, significance, and the objectives
of the study.
Rationale is the justification for why the research is necessary and
important in addressing a particular problem or gap in knowledge.
I. Introduction and Rationale
introduces the topic, states the research problem, outlines
objectives, explains significance, defines scope, and previews
the paper's organization.
Example
In the rapidly evolving landscape of education, where online learning has become
increasingly prevalent, the assessment and evaluation of teaching effectiveness are
more critical than ever. The quality of education depends heavily on the ability to
accurately measure and recognize exceptional teaching practices. However, the
process of evaluating teachers during online classroom observation is complex and
subject to variability in judgments among different raters and even within the same
rater over time. This variability can impact the reliability and validity of the evaluation
process, potentially hindering the professional growth and recognition of master
teachers. Therefore, this study aims to delve into the details of inter-rater and intra-
rater agreement among those responsible for assessing teachers in online classrooms,
offering valuable insights to enhance the precision and fairness of the evaluation
process in this increasingly digital educational landscape.
Introduction and Rationale
Prompt
Given the selected research title, “Rating the Raters: Examining the Inter- and Intra-Rater
Agreement among Master Teachers’ Evaluation During Online Classroom Observation ” this
study aims to assess and understand the agreement levels among raters evaluating teachers
during online classroom observation, both between different raters (inter-rater agreement)
and within the same rater over time (intra-rater agreement). Additionally, the research aims
to investigate factors influencing variability in ratings and evaluate the reliability and validity
of the evaluation process.
.
Introduction and Rationale
Prompt
Given the selected research title, “Rating the Raters: Examining the Inter- and Intra-Rater Agreement among Master Teachers’ Evaluation During Online
Classroom Observation ” this study aims to assess and understand the agreement levels among raters evaluating teachers during online classroom observation, both
between different raters (inter-rater agreement) and within the same rater over time (intra-rater agreement). Additionally, the research aims to investigate factors
influencing variability in ratings and evaluate the reliability and validity of the evaluation process.
Prompt: Please suggest a series of topics that I may discuss in alignment to the following guidelines:
1st – Provide the general description, global, national or local trend related to the research topic. This should be interesting and
specific.
2nd – Cite school or division data and information, its gaps and issues pertaining to the research topic.
3rd – Provide the purpose of the study using the school or division data and the identified gaps and issues as the primary reason
why you are conducting the research.
4th – Provide the significance of your study or its contribution to the teaching and learning and/or to the body of knowledge.
Kindly consider the context and available information within the Philippines while constructing your suggestions.
FAQ: Can ChatGPT assist us in generating written
content based on its previous response?
Warning!!!
Using ChatGPT to help with your research paper is useful, but you must be careful.
Relying too much on it can make your work less genuine and less valuable.
So, while ChatGPT is helpful, make sure your research still shows your own hard
work and understanding – a genuine reflection of your efforts and expertise.
Prompt:
Based on your previous suggestions, write the introduction and rationale for me.
Make sure to have smooth transition between paragraphs. Include References.
Do not use First person pronoun.
Search Engine AI Tools
Jenni.aI connectedpapers.com
Literature Review
is a critical and comprehensive examination of the existing scholarly literature, research studies, and published works
relevant to a particular research topic, question, or area of study. It serves several important purposes within
academic research.
ChatGPT Prompt
Rating the Raters: Examining the Inter- and Intra-Rater Agreement among Master
Teachers’ Evaluation During Online Classroom Observation ” this study aims to
assess and understand the agreement levels among raters evaluating teachers
during online classroom observation, both between different raters (inter-rater
agreement) and within the same rater over time (intra-rater agreement).
Additionally, the research aims to investigate factors influencing variability in
ratings and evaluate the reliability and validity of the evaluation process.
What series of topics and subtopics that you may suggest to effectively discussed
the literature review section?
Prescribed Guidelines
• Cite theories and/or previous studies related to the present research.
• Cite any DepEd policies on relative to your study.
• Identify inconsistencies or gaps in current knowledge or educational policy
that the study intends to address
• Sources are properly acknowledged and citation of literature sources is
consistent.
Addendum (Optional)
Theoretical framework is about understanding the theories behind
your research.
Conceptual framework is about planning how to do your research. Both
are important tools for researchers to make sense of their work.
Student Engagement:
Peer Tutoring
Student
Expected Outcome
Characteristics
Intervention
1.Active participation in mathematics
activities
Academic backgrounds Selection and training of peer 2.Increased interaction and
Motivation levels tutors communication among students
3.Improved attitudes towards
Learning styles mathematics learning
Prior mathematics One-on-one or small group
tutoring sessions Student Performance:
performance
1.Enhanced mathematical skills and
understanding
Tutoring strategies and 2.Improved test scores and grades in
techniques general mathematics
3.Increased confidence in solving
mathematical problems
Regular monitoring and
feedback
Addendum (Optional)
Theoretical framework is about understanding the theories behind
your research.
Prompt (Theoretical Framework):
Suggest list of theories aligned with the research title: Rating the Raters:
Examining the Inter- and Intra-Rater Agreement among Master Teachers’
Evaluation During Online Classroom Observation .
Research Design
Quantitative? – Assessment/ Scores
Qualitative? – Reflection/ Journals
Mixed? – Quantitative/ Qualitative
III. Research Question
With the Research Title: “Rating the Raters: Examining the Inter- and Intra-Rater
Agreement among Master Teachers’ Evaluation During Online Classroom Observation
and its objectives: to assess and understand the agreement levels among raters evaluating
teachers during online classroom observation, both between different raters (inter-rater
agreement) and within the same rater over time (intra-rater agreement). Additionally, the
research aims to investigate factors influencing variability in ratings and evaluate the reliability
and validity of the evaluation process, please create 3 research questions that fits and
aligned with the provided information.
Research Design: Quantitative
Miscellaneous Parts
V. Timetable | GANTT Chart
VI. Cost Estimates
VII. Plans for dissemination and utilization
VIII. References
Questions?
‘Wag na
Please! (^_^)
School Research Committee
(SHS)
Louie Junior I. Nanette C. Fatima E. Abundo Brenda D.
Montalbo Mancera Center for Almoneda
In-charge, Center In-charge, Center Qualitative Analysis In-charge, Center
for Literature for Ethics for Editing
Jerwin P. Ablay
School Research Manager
Our Effort
is to aid and educate teachers in their research,
emphasizing our sincere intentions.
"Let AI amplify your
research proposal's
brilliance, not
overshadow it."
- SRC
Thank you!
