Web Based Learning
Web Based Learning
Web Based Learning
By
Hassan Abd El-Aziz El-Sabagh
Assistant Lecturer, Mansoura Univ., Egypt
Supervisor:
Defense Committee:
Acknowledgement
Abstract
Over the last few years, the use of the web and simulation technologies in school
education has become widespread. The purpose of this study was to compare the impact
of a web-based Virtual Lab (WVL) environment with that of traditional educational
experience in relation to conceptual understanding and science process skills in natural
science for fourth grade primary school students. Using an instructional design model,
the author developed a WVL; the design consisted of 3D animations and interactive
experimental activities. The research instruments for the study were also developed; two
online pre/post tests on conceptual understanding and science process skills were used
to collect data. The sample used in the study consisted of 70 students from two primary
language schools in Mansoura city, Dakahlyia Governorate, Egypt. The sample was
divided into an experimental group and a control group. The author used an
experimental design wherein the experimental group was exposed to the WVL, while
the control group studied in a traditional setting and performed related activities.
The pre-test results indicated that the entry-level for conceptual understanding in
science and science process skills of both groups of students were equal, which
guaranteed the reliability of the research. The findings of the post-test highlighted the
following points: (a) Students in the experimental group had significantly higher mean
scores in conceptual understanding especially in two of cognitive levels. (b) The
experimental group performed better in science process skills, especially in five of these
skills. (c) There was no significant difference in the performance of boys and girls
within the experimental group for science process skills. (d) The estimation of the effect
sizes (indication of the level of difference between the post-test scores of the
experimental and control group) revealed that, the effect size was large for two skills,
medium for three skills, and small for only one skill. In conclusions, the WVL provided
considerable support for fourth grade students and helped them to improve their
conceptual understanding in science and science process skills. These results go beyond
previous research results, which did not focus on very young learners. The use of WVL
contributed considerably in elevating learning outcomes; the results provided an
empirical evidence of the advantages of web-based learning (WBL) for education policy
makers.
Keywords: Virtual Lab, web-based learning, 3D animations, simulation, science
education, E-learning, science process skills, primary education.
I
Acknowledgement
in
den
Naturwissenschaften
der
vierten
Klasse
der
zwei
Online-Pre/Post-Tests
zum
konzeptionellen
verstndnis
und
Es
gab
keinen
signifikanten
Unterschiede
in
den
wissenschaftlichen
II
Acknowledgement
fhigkeiten mittelmig ist, fr zwei fhigkeiten sehr gro und nur fr eine fhigkeit
klein ist.
Die Schlussfolgerung ist, dass die WVL betrchtliche untersttzung gewhrt und hilft
den Studenten der Klasse vier, ihr verstndnis fr die Begriffe der Wissenschaft und
der prozessfhigkeiten zu entwicklen. Dieses Ergebnis geht weit ber die bekannten
verffentlichungen auf diesem Gebiet hinaus. Die Ergebnisse dieser Studie vertiefen das
verstndnis ber lernergebnisse des Virtual Lab und sind eine evidenz fr die vorteile
von Web-Basiertem Lernens (WBL) mit relevanz fr politische entscheidungstrger, auf
deisen ausbildungsgebiet.
Stichwort: Virtual Lab, Web-basiertes Lernen, 3D-Animationen, Simulationen,
wissenschaftliche Bildung, E-Learning, Wissenschaft Prozess Fhigkeiten im
Primarbereich.
III
Acknowledgement
Acknowledgements
Definitely, many great people have contributed to this production. My deepest
appreciation is to my supervisor, Professor Thomas Koehler Director of Media Center
and Professor of Educational Technology at TUD. I had the chance to have an advisor
who gave me the independence to explore on my own and at the same time the guidance
to get better when my steps paused. The support for taking part in international
conferences motivated me as well. His perceptive guidance, helpful advices and his
great patience helped me overcome many problems and finish this dissertation.
The author expresses grateful appreciation to Professor Zaher A. Mohamed Professor of
Biochemistry at Fayoum University and Part-time professor of Educational Technology
and Curriculum Development in Cairo University, Egypt, for the support that helped the
author to finish my work and for giving me advices of the dissertation and reviewing it.
The author is very thankful to Professor Manuela Niethammer for the discussions that
helped me review the educational and technical part of the program and for giving
advices of the dissertation.
My appreciation for the support and cooperation of Media Center staff. I am thankful to
many colleagues who supported me and shared their experiences, especially, Dr. J.
Neumann, Ms. A. Schimmeck, Mr. S. Mnster, Mr. M. Ksiazek, and Mr. J. Raff. In
addition, I would like to thank primary language schools' teachers in Mansoura, Egypt
who helped in executing the experimental treatment, especially Mr. M. Abd Allah, Mr.
M. El-Morsi, and Mr. Nabil.
It is a pleasure to express my gratitude to my wife Noura. I am warmly grateful for her
encouragement and understanding to pursue my dissertation.
I would like to thank my mother, my sister and brothers for reinforcing me to complete
this work.
Finally, the author extends his appreciation to the Ministry of Higher Education in
Egypt, especially the culture Bureau, Egyptian Embassy in Berlin for the financial
support of this research, and for motivating the researchers through regular meetings.
Dresden, October 2010
Hassan A. El-Sabagh
IV
Table of contents
Table of Contents
ABSTRACT ..................................................................................................................... I
ABSTRACT IN GERMAN LANGUAGE................................................................... II
ACKNOWLEDGEMENTS ......................................................................................... IV
TABLE OF CONTENTS ...............................................................................................V
LIST OF FIGURES ...................................................................................................... IX
LIST OF TABLES ..........................................................................................................X
LIST OF ABBREVIATIONS .................................................................................... XII
1.
INTRODUCTION .................................................................................................. 1
1.2.
EGYPTIAN SCHOOLS....................................................................................................... 2
2.
1.3.
1.4.
1.5.
1.6.
1.7.
1.8.
DISSERTATION STRUCTURE................................................................................ 9
EDUCATION ................................................................................................................ 11
2.1.
OVERVIEW ....................................................................................................... 11
2.2.
2.2.1
Introduction ........................................................................................................................ 11
2.2.2
2.2.3
Table of contents
2.2.6
2.2.7
2.3.
2.4.
2.4.1.
Introduction ........................................................................................................................ 36
2.4.2.
2.4.2.1.
2.4.2.2.
2.4.2.3.
Conclusion ................................................................................................................ 38
2.4.3.
3.
2.4.3.1.
Introduction ............................................................................................................... 39
2.4.3.2.
2.4.3.3.
2.4.3.4.
Conclusion ................................................................................................................ 43
2.5.
2.6.
ENVIRONMENT ......................................................................................................... 45
3.1.
INTRODUCTION ................................................................................................ 45
3.2.
3.2.1.
3.2.1.1.
3.2.1.2.
3.2.1.3.
3.2.2.
3.2.2.1.
3.2.3.
3.2.3.1.
4.
3.2.4.
3.2.5.
VI
Table of contents
4.1.
INTRODUCTION ................................................................................................ 57
4.2.
4.3.
4.4.
4.4.1.
4.4.2.
4.4.3.
4.4.4.
Conclusion .......................................................................................................................... 61
4.5.
4.5.1.
Sampling ............................................................................................................................. 62
4.5.2.
4.5.3.
4.5.4.
4.5.5.
4.6.
5.
6.
CONCLUSION ................................................................................................... 68
RESULTS .............................................................................................................. 69
5.1.
5.2.
5.3.
5.4.
INTRODUCTION ................................................................................................ 88
6.2.
6.3.
CONCLUSIONS ................................................................................................. 92
6.4.
RECOMMENDATIONS ....................................................................................... 94
7.
REFERENCES ..................................................................................................... 96
8.
APPENDICES..................................................................................................... 107
APPENDIX-A SPS TEST ............................................................................................ 107
APPENDIX-B CONCEPTUAL UNDERSTANDING TEST .................................................. 117
APPENDIX-C SOFTWARE EVALUATION FORM .......................................................... 125
APPENDIX-E LEARNING OBJECTIVES ....................................................................... 156
VII
Table of contents
VIII
Table of contents
List of Figures
FIGURE 1 STRUCTURE OF THE DISSERTATION .................................................................. 10
FIGURE 2 SELECTION OF POTENTIAL BENEFITS OF A VIRTUAL LABORATORY .................. 12
FIGURE 3 MODES OF USAGE OF VIRTUAL LABS ............................................................... 17
FIGURE 4 TYPES OF RESEARCH METHODS ....................................................................... 20
FIGURE 5 DATA COLLECTION METHODS .......................................................................... 22
FIGURE 6 SCIENTIFIC DISCIPLINES ADDRESSED BY V-LAB ............................................... 29
FIGURE 7 ADDIE MODEL ................................................................................................ 45
FIGURE 8 PROPOSED INSTRUCTIONAL MODEL FOR V-LAB ENVIRONMENT ....................... 47
FIGURE 9 BASIC CONCEPTS FOR LAB TOOLS ..................................................................... 48
FIGURE 10 BASIC CONCEPTS FOR LABORATORY WARNING SIGNS .................................... 48
FIGURE 11 BASIC CONCEPTS FOR MATTER ...................................................................... 49
FIGURE 12 SUGGESTED DESIGN STRUCTURE USED IN DEVELOPING THE V-LAB .............. 54
FIGURE 13 EXPERIMENTAL RESEARCH DESIGN OF THE STUDY ........................................ 57
FIGURE 14 STUDENTS FILLED DATA INTO THE PASSWORD ACCESS PROVIDED BY V-LAB . 64
FIGURE 15 STUDENTS CHAT ROOM PROVIDED BY V-LAB ................................................ 64
FIGURE 16 STUDENTS LOG IN PAGE ................................................................................ 65
FIGURE 17 MAIN FEATURES FOR EXPERIMENTAL AND CONTROL GROUPS ........................ 65
FIGURE 18 COMPARISON OF BOTH GROUPS AND SCIENCE PROCESS SKILLS ACQUIRING.... 77
FIGURE 19 COMPARISON OF STUDENTS' GENDER WITHIN EX. GROUP CONCERNING EACH
SKILL OF SCIENCE PROCESSING ................................................................................ 79
IX
Table of contents
List of Tables
TABLE 1 THE DEVELOPMENT IN THE TOTAL NUMBER OF SCHOOLS, STUDENTS AND
TEACHERS IN EGYPTIAN SCHOOLS (2004/2005 TO 2008/2009) .................................. 3
Table of contents
XI
List of abbreviations
List of abbreviations
2D
Two Dimension
3D
Three Dimension
AAAS
ADDIE
BSPST
Co.
Controlled
Conf.
Conference
CU
Conceptual Understanding
CVD
DF
Degree of freedom
Ed.
ES
Effect size
et al.
And others
etc.
And so forth
Ex.
Experimental
F.
Females
G.
Graph
i.e.
That is
ISD
IVPL
J.
Journal
lab
Laboratory
M.
Males
N./No.
Number
p. / pp.
Page, Pages
XII
List of abbreviations
P-value
SD
Standard Deviation
SPS
SPSS
URL
V-Lab
Virtual Lab
VR
Virtual Reality
VS
Versus
XIII
No./Year
Schools
Students
Teachers
2004/2005
38922
15511818
826348
2008/2009
43423
16101210
809241
Table 1 illustrates the fact that, however the number of students in Egyptian schools is
increasing, the number of teachers is decreasing. As a result, an opportunity for
technology to take part in the learning process is very crucial. However, according to
2008/2009 statistics shown in table 2, the average number of students per classroom is
approximately forty-three. Regarding primary schools, this average number varies
between governorates (in some governorates is thirty five, while in others is over fifty
five, depending on school age density). The classroom density, primarily in primary
schools, is considered one of the major problems facing basic education in Egypt,
especially in Nile Delta governorates and Greater Cairo.
Table 2 The development in the total number of schools, classrooms and students in Egyptian
primary schools (2004/2005 to 2008/2009)2
No./Year
Schools
Classrooms
Students
2004/2005
16369
203676
8634115
2008/2009
16866
212084
9207323
(2004/2005 to 2008/2009)3
No./Year
Langue Schools
1991/1992
2004/2005
195
898
2008/2009
1420
Table 3 shows that, between 1991/1992 and 2004/2005, there was rapid rate of increase
(about 460%), while the increasing rate was about 150% for the next four years. This
means that there was a high spread of establishing such schools due to the high quality
of the instructional process (including teaching science and math in English), which led
to high performance of students.
In this context, the Egyptian Ministry of Education launched a technological
development project in 1995 to establish a well-equipped "Center for Technology
Development" in each of the 29 educational directorates (one in each governorate). This
project aims to develop, integrate and use information and communication technologies
in education in Egypt, and to create a learning environment that enables students to
create their own learning experience through using information resources and
technological devices to find the information (Ministry of Education, 2007). Recently,
and according to the National Strategic Plan for improving pre-university education in
Egypt (Ministry of Education 2008, 185, English version), the goal for chapter five is:
"Develop and install the ICT infrastructure and technical support needed to implement
and sustain modern pedagogy and effective educational management and planning".
This goal could be achieved during five years through the following five operational
objectives:
For a long time, the main approach for teaching and learning in Egyptian schools was
mainly the didactic traditional approach, which depends on memorization where
teachers are the main source of information, and students are only passive receivers.
This approach does not allow learners to engage actively in the learning process, and
hence the pedagogical approach in Egyptian schools for a long time did not provide the
best support for students to develop conceptual understanding and science process
skills, especially in science learning. The strategic objectives of the Egyptian Ministry
of Education now are moving towards the implementation of active learning approach,
wherever it is possible due to the class high-density constraints.
The current pedagogical practices in high-density Egyptian primary schools were taken
into account in this research. For example, web based V-Lab was designed in order to
change the students' perception of learning processes by transforming their learning
experiences gradually from a teacher-centered approach to a student-centered approach
where they take the responsibility and the control of their own learning and acquiring
the new knowledge.
By now, and since the beginning of Technology Development Project, all Egyptian
schools are equipped with infrastructure and different facilities to enable them to use
information and communication technology. According to Ministry of Education
statistics in 2009, there is a number of schools that technologically developed and
provided with a small computer lab (the number varies and sometimes reaches up to 30
computers) and multimedia unit to connect to the internet. The labs were also provided
with data projector, television, video player, screen and the well-known overhead
projector.
1.3. Research problem
One of the weaknesses in primary school's education is "insufficient learning of natural
science subjects". This insufficiency might be due to the level of teaching, and
consequently the ability of students to use science knowledge and to practice science
Enhance science process skills that are necessary for lab work and science
education as basic aspects.
Dick, W., Carey, L., & Carey, J. (2001). The Systematic Design of Instruction, (5th Ed.). New York:
Addison-Wesley Longman.
Second stage:
Designing phase is relating to determining the required activities and organizing
them, and then
Selecting 3D graphics is suitable to deliver the concepts.
Third stage:
Developing the web-based Virtual Lab according to design of V-Lab in the
frame of the web site.
Designing the activities in a simulated environment and achieving the usability
in interactions.
Getting feedback from experts.
Conducting pilot experiments on some students.
Fourth stage:
Experimental treatment (implementation): two trials took place in order to
evaluate the impact and usability of both the activities and the web-based V-Lab.
Fifth stage:
Evaluation process: defining a set of methods used in order to collect data from
different perspectives, especially during the instructional designs phases.
Interpretation of the collected data and reporting in the dissertation.
10
11
This part is organized into the four following sections: purpose and questions of this
review, method, results, and discussion, which includes major conclusions in the
searched literature.
2.2.2 Purpose and questions of this review
The purpose of this sector is to review the empirical literature related to the use of the
V-Lab as an instructional technology tool. Specifically, this review was led by the
following questions:
1- How is the Virtual Lab used by students and teachers?
2- Which types of research methods have been applied using V-Lab in educational
settings?
3- Which data collection methods are used in the research on V-Lab?
4- Which research topics and models have been conducted on V-Lab in
instructional settings, as well as related findings?
12
13
14
15
16
17
Experiment research
Experimental research is mainly useful in addressing evaluation questions about the
effectiveness and impact of programs. It is a collection of research designs that use
treatment and controlled testing to understand causal processes (Gribbons and Herman,
1997). Experimental research involves an experimental group and a control group to test
hypotheses regarding certain treatments or causation (Ross and Morrison, 1997); for
example, using V-Lab leads to better students' learning. Two groups exist in the
experimental design: a treatment group inside and a control group outside the V-Lab.
Moreover, in experimental research, participants are randomly assigned (Chen et al.,
2008). In the current review only seven papers (Sommer, B. and Sommer, R. 2003;
Lawson and Stackpole, 2006; Noguez, et al., 2007; Chen, et al., 2008; Dalgarno et al.,
18
Quasi-experiment research
This method refers to the evaluation of educational programs when random assignment
is not possible or suitable (Gribbons and Herman, 1997). Five papers (Limniou et al.,
2007; Mtrailler, et al., 2008; Koretsky, M. D. et al., 2008; Swan and ODonnell, 2009;
Yang and Heh, 2007) utilized this research method to investigate and compare the
impact of V-Lab on traditional laboratory instruction in certain disciplines. Data sources
in the studies included pre/post-test, questionnaire, only post-test, and survey.
Development research
Developmental research refers to studying the design, development, and evaluation
process of certain educational interventions methodically (Richey and Nelson, 1996).
The development of some new V-Lab systems is also viewed in this type. Only three
papers (Rong et al., 2005; Subramanian and Marsic, 2001; Bickmore and Schulman,
2009) fell into this category. Data sources in the studies included questionnaire, survey,
observation, and content analysis.
Results indicated that, overall, descriptive research was the most common type of
research method (58.3%), followed by experimental approach (19.4%), quasiexperimental (13.9%), and developmental research (8.3%). Figure 4 illustrates the
percent of the various types of research methods.
19
Tests
Tests, as data collection method, include pre-test and post-test. Here the pre-test is an
instrument used to collect participants performance data before V-Lab-treatment. On
the other hand, Post-test, is an instrument used to collect participants performance data
after the treatment. An example of pre-test and post-test data is participants scores for
achieving physics before and after studying scientific materials via virtual lab,
respectively. Several authors used testing method in their researches (Yang and Heh,
2007; Noguez, et al., 2007; Mtrailler, et al., 2008; Chen, et al., 2008; Dalgarno et al.,
2009; and Maldarelli et al. 2009).
Observation
This data collection method is conducted by a researcher when observing participants in
natural contexts in order to get an indication of their behaviors or activities (Knupfer
and McLellan, 1996). This method was used by some authors to examine the interactive
behavior (Subramanian and Marsic, 2001; Lawson and Stackpole, 2006; and Hatherly,
et al., 2009).
21
Conclusion
As a conclusion of the methodological analysis, results showed that the largest portion
of all data collection methods used in previous studies were questionnaires (32.5%),
followed by tests (20%), content analysis (17.5%) and interview/focus groups (17.5%).
Only a small number of studies used observation (12.5%) as a data collection method.
A related issue is that of statistical tests, which were often used in the past to conduct
empirical studies. The author found many statistical tests, which were categorized
according to kinds of data; describing, exploring or testing hypotheses, or seeking
correlations. Statistical tests used were mostly of a descriptive type (mean, standarad
deviation, and percentage), followed by one-way ANOVAs and t-tests (independent and
paired samples). A smaller number of studies applied advanced tests (e.g. ANCOVA,
factorial ANOVA, linear mixed model, MANOVA and MANCOVA).
22
Topic
Learning outcomes
Attitudes
Communication and remote tool
Frequency count
18
12
8
23
25
26
28
Conclusion
In conclusion, as shown in figure 6, the author summarizes the various settings in which
past research on V-Labs had been conducted.
29
30
31
32
33
34
35
Year
1996
1998
2008
2001
2007
Researchers
Ainge
Alberti et al.
Bergerud
Gervasi et al.
Brenton
2006
Khler &
Scheuermann
Adamo-Villani et al.
2006
Concern
Recognize 3D-shapes
Historic theatre
3D-SBL
The objects visualization
Undergraduate tuition of the
nervous system
3D-interactive simulation in
form of a game
3D-modeling and animation
Research Design/Type
Descriptive
Descriptive
Descriptive
Descriptive
Descriptive/Developmental
Developmental/Experimental
Descriptive/Developmental
Conclusion
In conclusion, integrating 3D features appears to be a promising technology for learning
process and offers many benefits for knowledge acquisition. 3D enables difficult
learning through the utilization of environmental stimuli similar to real world settings.
Additionally, it encourages users to learn by providing educational resources that are
stimulating, attractive, and easy-to-use. The utilization of these technologies, including
animation tools, should be controlled by learning styles, and instruction.
36
non-scientific
ideas.
Additionally,
studies
outline
that
some
38
39
skills
include
observation,
inference,
classification,
measurement,
communication, and prediction. It is evident that, not all students will become practicing
scientists, but there is a desire to instill scientific attitudes that are favorable for all
individuals. Children can acquire those skills by engaging in process skills, which will
help them become problem solvers and capable to apply these skills in real-world
contexts. Educators have promoted the use of process skills in science classrooms over
thirty years based on strong research and science education documentation (such as
National Science Education Standards) that supports teaching of these fundamental
skills (Haury, 2002). Classroom studies on scientific reasoning have centered on the
basic and integrated science process skills where many researchers have focused their
attention on these skills over the past three decades (e.g. Germann and Aram, 1996,
773-798; Rainford, 1997). The basic science process skills (BSPS) provide the
intellectual groundwork for scientific inquiry, such as the ability to order and describe
natural objects and events. Examples of the BSPS are observing, classifying, measuring
and predicting. The BSPS are the prerequisites for the integrated process skills. The
ability to use BSPS is attributed to the ability to perform empirical-inductive reasoning
or Piagetian concrete operational reasoning (Ali, 2001, 97-107; Germann and Aram,
1996). The literature on BSPS presents six basic science process skills (Padilla, 1990;
Rezba, et al. 1999; Yockey, 2001; Rezba, 2002) including:
40
Observation
Students observe using their senses to gather information about objects or events. This
is the most fundamental of all the process skills and the primary approach through
which students obtain information. For example, a student could describe a test tube as
round, and transparent. Students can also use scientific instruments to aid in their
observations such as thermometers, rulers, and balances.
Communication
Communication can take many forms including using words, actions, or graphic
symbols to describe an action or event. It needs students to use information that they
have gathered from observations.
Inference
Making inferences involves using proof to explain events that have taken place or things
that have been observed. It is important to help students to distinguish between their
observation and inferences. For example, students may observe water vapor and
conclude the physical change in the state of water. They may observe the size, shape,
and direction of movement, but when starting provides explanations for these
observations, they are then making inferences. For example, students may infer that the
change of water from one state to another is a physical change when observing water
vapor coming out from the beaker, which is able to condense and convert again to water
droplets.
Classification
Classification involves setting objects in groups according to some ordinary
characteristic. Students could be encouraged to develop this skill by asking them to
group or arrange objects according to their observed properties. For example, students
are able to sort a collection of lab tools into different groups, i.e. measuring tools,
heating tools, warning symbols, or to any other group according to observable
characteristic.
Measurement
Measuring consists of using both standard and nonstandard measures to explain the
dimensions of a tool, as in, identifying length, volume, and mass according to the ability of
the instrument.
41
42
44
45
1st Analysis
21
2nd Analysis
18
Reliability
91.7
46
Analysis
- Identify learners' needs and characteristics
- Identify learning goals and objectives
- Prepare concept list
- Develop science checklist
- Evaluate each step
Design
- Craft learning and performance objectives
- List and organize learning activities
- Identify instructional strategies
- Identify suitable graphics
- Determine the appropriate interactions
- Create web site outline
Proposed Instructional
Model for V-Lab
Environment
Development
- Choose delivery system
- Construct 3D models (cinema4D),
Designing simulations (Flash),
synthesize web site, Java (test)
- Apply graphic organizers
- Review existing material
Implementation
Identify instruction and practices
Conduct pilot study
Check implementation
Correct the mistaks
Utilize instructional materials
Evaluation
- Analysis problems
- Measure outcomes
- Conduct formative evaluation
(Online interview, evaluation form)
- Conduct summative evaluation
47
48
49
Participants were asked to evaluate each process skill using Likert scale: (3- Essential,
2- high priority, 1- beneficial to know, 0- not necessary to know). Arithmetic means
and variance (pooled samples) were calculated, taking into consideration the variation in
number of responses to each item. Skills are placed in ranking order of importance from
most to least important. Based on survey responses, a mean response score of 2.0 was
used for the division point, as shown in table 7 and appendix (G). The final list has been
explained as follow.
Table 7 Science checklist and development of science process skills
Science endeavors
Revealing general knowledge of main lab tools and
warning symbols.
Recognizing "matter" concept.
Distinguishing between observations and inferences
for matter topic.
Classifying main lab tools in categories.
Constructing and using diagrams and graphs.
Specifying accurate tool which could be used for
accurate measurement.
Predicting the results for a proposed lab test or setup.
Using a microscope to perform a requested task.
Recognizing density of different substances based on
volume and mass.
Total
Mean Variance
respondents
21
2.83
0.08
20
21
2.76
2.67
0.13
0.18
21
19
2.56
2.18
0.25
0.27
21
2.03
0.29
20
21
21
2.01
1.96
1.78
0.30
0.31
0.36
In the present study, the researcher used Bloom's taxonomy of educational objectives.
A learning objective describes what students should be able to do at the end of the
program (they could not do before) (Bloom et al., 1956). The developed learning
objectives concerning conceptual understanding and use science process skills are
included in Appendix (E). With respect to understanding science concepts, the
researcher focused on the first four levels of Bloom's taxonomy (Knowledge,
Comprehension (understanding), Application, and Analysis). Meanwhile, science
process
skills
involved
basic
skills
(Observation,
Inferring,
Classification,
51
Content organization is seen to be a key element that might influence the whole course,
hence the researcher organized the activities in a logic mode. Activities and assessment
were designed in a way to ensure achieving learning objectives. Appendix (D)
illustrates in detail screenshots of simulated activities.
The Virtual Lab activities were integrated into a sequence related to science process
skills. To allow learners to work at their own pace, each one had access to the Virtual
Lab learning procedure described in the following section.
3.2.2.1. Identification of the suitable graphics to teach content types
There are different types of graphics that can help students acquire elements of the
content effectively (Adapted from (Clark, 2008, 58-73)).
Table 8 Types of graphics to teach content types
Content
type
Concepts
Procedure
Process
Description
Groups of objects,
events, or symbols
designated by a single
name.
A series of steps
resulting in
experiment
completion of a task.
A description of how
something works.
Useful graphic
type
Representational
Interpretive
Organizational
Example
Transformational
An animated illustration
of how to perform or an
experiment which could
be done
Animations of how the
lab equipment works
diagrams to Illustrate
experiments.
Transformational
Interpretive
Relational
A tree diagram of
scientific concepts.
Figures ( 8,9, and 10)
Principle
Transformational
Interpretive
Facts
Representational
Organizational
A screen captures of
a vapor a table of parts
names and specifications.
In respect to the previous table, the following table delivers a description for each
graphic type and provides examples relating to lab tools, warning symbols and "matter"
concepts according to the researcher understanding.
52
Graphic Type
Representational
Organizational
Type Description
Example
Visuals that illustrate the 1. Illustration of equipment
Appearance of an object.
or tool.
2. A screen capture to
present a science concept.
Visuals
that
show 1. A concept map
qualitative
relationships 2. A tree diagram.
among content.
Reference to table 9, the researcher used the concepts and process types and certain
graphic types such as representational and transformational to deliver such types. The
representation structure for topics and experiments was divided into the following
sections: concepts maps, text boxes, animations, images, audio, and interaction
elements. Every activity has an obvious purpose, it included concepts, developing basic
science process skills, and representing knowledge in a graphic formats.
3.2.3. Third phase: Development
Based on the design phase, the production of learning materials and web-based Virtual
Lab designing and programming were completed in the development phase which
included developing flash and 3D animations files. The Virtual Lab was delivered via
web on standard desktop computer. The platform of the project was based on using
Cinema4D software to build objects, models and textures of the 3D lab components and
to animate their functionality and Flash to provide interaction. This framework was
involved into web-based environment.
53
The researcher made sure that all activities were designed well considering the time,
might be spent by students on each activity. Three students were selected for a trial to
complete some of these activities, and assessments. The researcher used the snapshot
and 3D animations to display the basic lab tools to visual examples and to post these
images and animations on the web page for students benefit.
Virtual Lab environment included many creative activities suited for primary school
students. The features of the proposed virtual science lab shown in figure 12 were
identified as Media-rich graphics and animations, Interactive simulations, which were
presented in the context of science activities, in addition, 3D models, were animated,
more interactive exercises and self-assessment were developed. Virtual Lab was a
distributed environment of simulation and animation tools, intended to perform the
interactive simulation.
V-Lab
Simulation
Graphic organizers
Interactivity
3D Animation
54
55
The evaluation phase helped the researcher to determine whether students' interaction
with the content was successful and how it could be improved for the next
implementation phase.
56
According to figure 13, (Ex. G.) refers to experiment group, whereas (Co. G.) refers to
control group, however, (CU-test) refers to conceptual understanding test, and (SPStest) refers to science process skills test. The idea of this design depends on selecting
two groups, the first represents the experimental group, and the other represents the
control group. Study instruments were implemented on both groups beforehand. In
57
order to develop conceptual knowledge and science process skills, both of groups were
examined via evaluative instruments.
4.3. Variables of the study
The current research design depends on the experimental design. The main issue in this
design is to measure the effect of the independent variable on changing dependent
variables.
Table 10 Variables of the study
Independent variable
Web-Based Virtual Lab
Dependent variables
Conceptual Understanding
Science Process Skills
In respect to table 10, independent variable is the web-based Virtual Lab, which is being
tested against dependent variables, i.e. student conceptual understanding, and
development of science process skills.
4.4. Evaluation Instruments
The evaluation instrument used in this study was pre/post-tests. The tests were prepared
by the researcher to evaluate the impact of the web-based V-Lab on development
concepts and science process skills. Selecting the test questions based on three criteria:
(1) questions effectively cover a selection of the academic content standards; (2)
questions demonstrate a range of difficulty, and (3) the released questions reflect all the
cognitions and skills that could be assessed. An initial draft of both instruments was
constructed and given to independent science specialists; their feedback was used to
fine-tune the format and structure of the instruments.
4.4.1. Conceptual Knowledge Test
The conceptual test comprised of items deal with lab tools, warning symbols and matter.
It included an initial set of 15 multiple-choice questions (MCQ), with four answers for
each item. They were selected from various sources: science textboxes, science
encyclopedia and past year examination questions, they were modified when it was
necessary and appropriately. The current level of each question was assessed against the
first four levels (Knowledge, Comprehension, Application, and Analysis) of Blooms
58
taxonomy of educational objectives in the cognitive domain. Esiobu and Soyibo (1995),
as cited in Thompson and Soyibo (2002, 25-35), suggested that, test items which
measure students' understanding of science concepts, should test cognitive levels
beyond comprehension level of Blooms taxonomy. For this reason, the conceptual
understanding test, which was prepared according to basic criteria, was checked to be
sure that the selected questions were appropriate to students level. The number of test
items in different cognitive levels were identified as follow: knowledge level (two
items), comprehension level (five items), application level (two items), and analysis
level (four items). This determination was identified according to relative weights of
program elements, which is shown in table 11.
Program Content
Levels of objectives
Knowledge
Comprehension
Application
Analysis
Total
The relative
weight of
program
54%
--
46%
Relative weight
of the objectives
15.4%
38.5%
15.4%
30.7%
13
100%
The formulation of the 15 MCQ test items was finally checked against experts review.
The conceptual understanding test was applied before and after the implementing VLab.
As a result of the pilot study, two questions were excluded when the actual study was
conducted, since students' (pilot) feedback was negative, either for the difficulty of the
questions, or possible misinterpretations. Another negative feedback was the long time
(30 minutes) allowed for the whole test. Finally a set of 13 items was considered to
assess students understanding of science concepts (with emphasize on lab tools,
warning symbols and matter) to be answered within 20 minutes with a maximum points
of 26.
59
60
Test
No. of cases
Conceptual
understanding of science 20
concepts
18
Controlled
No. of items
Alpha
13
0.820
14
0.852
Table 12, shows that, the Cronbach's alpha for conceptual understanding test (0.82) as
well as SPS test (0.85) were high, which means that the tests were reliable.
Table 13 Reliabilities of test items for science process skills subscales
Subscales
Observation
Inferring
Measurement
Classification
Communication
Prediction
No. of items
2
3
3
3
2
1
Alpha
0.82
0.86
0.81
0.91
0.87
0.84
As seen in table 13, the Cronbach's alpha measured for test items specified for each
science process subclass was high and ranged from (0.81 to 0.91).
4.4.4. Conclusion
The purpose of previous section was to examine the validity and reliability of the both
study instruments (tests). The two most important aspects of accuracy are reliability and
validity. Reliability refers to the reproduction of a measurement; poor reliability reduces
the precision of a measurement and reduces ability to follow changes in measurements
in experimental studies. On the other hand, validity refers to the degree to which a study
accurately reflects or assesses the specific concept that the researcher is attempting to
measure.
61
Group
Mean
Std.
Experimental
31
10.580
3.658
Controlled
31
11.636
3.444
t
1.189
p
0.239
62
Group
Mean
Std.
Experimental
31
11.935
4.802
Controlled
33
11.030
4.693
t
0.762
p
0.449
The results presented in table 15 indicated that there was no significant difference
between both experimental and control groups in the entry-level concerning science
process skills because there was no significant difference in the mean scores between
both groups (p > 0.05).
4.5.2. Experimental treatment and procedures
During the treatment period (approximately four weeks), students activities were
recorded using a web site log system, while assessment results were recorded at the
control panel management by the researcher (Appendix D). At the beginning of the first
semester of school year 2009-2010, a one-hour orientation session about how to use the
web site, its components, and the URL of the web site was given to students via science
teacher. In the orientation session, each student was informed with his/her user name
and password for accessing the web site (Fig. 14), registration process was also
provided, in addition to a short orientation about web site registration, log in (Figure
16), and using online assessment instruments.
63
Figure 14 Students filled data into the password access provided by V-Lab
The shat system was important in many aspects such as students discussing their views
and ideas about the activities enriching their own knowledge and sharing their own
experiences. At the end of the program, the experimental group was asked to answer the
given quizzes (set of various type questions based on Bloom taxonomy and science
64
process skills were provided as part of the website) in a given time. Each student was
allowed to observe the obtained grade and identify his/her level.
During the implementation period, students in the control group studied the same
learning materials as those in the experimental group, except that they did not use the
Virtual Lab learning activities. Their learning activities included classroom lectures and
related activities. During the treatment, students were allowed to show their control
panel after answering the questions section.
Features of the treatment groups
Control group
Traditional Learning
Environment
Text book
Text
Experimental group
Web based V-Lab
Main foundation
Format of content
Linear
Presentation format
Synchronous
Time/space based
classroom
Interaction type
Interaction space
Web-based resourss
Simulation, 3D
Hypermedia
Asynchronous/
Synchronous
65
66
Aim
Looking
for
difference
between
conditions
Number of
Design
Parametric/Non
variables and
parametric
conditions
One independent - Independent
Parametric
variable; two
measures
conditions, one
(unrelated)
dependent
- Repeated measure
variable or more
Related
Statistical
test
Independen
t-test;
Related
t-test.
67
No. of cases
23
No. of items
18
Alpha
0.8895
The second questionnaire was prepared to identify science checklist for developing
science process skills and consisted of 13 items. The respondents were school teachers,
pre-service teachers and specialists in university.
Participants were asked to evaluate each process skill using the following scale:
3- essential, 2- high priority, 1- beneficial to know, 0- not necessary to know.
Arithmetic means and variance (pooled samples) were calculated due to the variation in
number of responses to each item. Skills were placed in rank order of importance from
most to least important. Based on survey responses, a mean response score of 2.0 was
used for the division point. The final list has been explained in table 7, above.
The third questionnaire served as an evaluation instrument to evaluate the software
through from the pedagogical value and design aspects (Appendix C). Eighteen experts
responded to the questionnaire where the most common remarks were related to
removing some pictures and editing the colors of activities, making certain activities
more interactive, correcting some errors in web sites, maximizing some fonts, and
changing the feedback system. The researcher uploaded the updated files within web
site after performing the required changes.
4.6. Conclusion
After reviewing of literature, the researcher focused on the study problem variables,
which helped to identify the relationships clearly. The main type of research design in
this study was the experiment design, which used to structure major parts of the
research procedures: samples, measures, and treatments. Concerning the research
sample, it was not possible to study the entire population ''4th grade students'' in terms
of cost, time, and availability of computers that are connected to internet in school lab.
For these reasons, a limited sample was chosen randomly to represent the whole
population in this study. Questionnaires and tests were used to collect data, taking into
consideration the nature of the investigation, students, objectives, scope of the science
education, and time. SPSS software was used for data entry and analysis, in addition to
Excel for extracting the required graphs.
68
Results
5. Results
This chapter examines research hypotheses and provides findings of the research based
on statistical analysis (t-test) and interpretation of data concerning conceptual
understanding and science process skills.
5.1. Proof of Hypothesis
H1: There is a significant difference, in terms of students' conceptual
understanding, between students who are exposed to the Virtual Lab
environment and those who experienced traditional instruction.
Table 19 Results of implementing conceptual understanding test at the end of the experiment
Group
Mean
Std.
Experimental
31
16.129
3.792
Controlled
33
12.545
4.366
Experimental (F.)
18
16,333
4,014
Controlled (F.)
17
11,882
4,211
Experimental (M.)
13
15.846
3.601
Controlled (M.)
16
13.250
4.553
3.495
0.001*
3.201
0.003*
1.672
0.106
69
Results
Group
Mean
Std.
Experimental
31
2.903
1.011
Controlled
33
3.151
1.121
t
0.928
p
0.357
As shown in table 20, the results show that the mean scores of conceptual understanding
post-test (knowledge level items) for students in the experimental group were
statistically insignificant in comparison with those of the control group, as p > 0.05.
Group
Experimental
31
5.806
2.088
33
4.181
1.758
Controlled
* Significant at 0.05 level
Mean
Std.
3.374
0.001*
According to the results presented in table 21, the mean scores of conceptual
understanding post-test (comprehension level items) for students in the experimental
group were significantly higher than those of the control group as the p < 0.05.
70
Results
Table 22 Mean Scores, Standard Deviation, and p-values of Application level in post-test
Group
Mean
Std.
Experimental
31
2.322
1.720
Controlled
33
1.757
1.392
1.448
0.153
As shown in table 22, the results prove that the mean scores of conceptual
understanding post-test (application level items) for students in the experimental group
were statistically insignificant in comparison with those of the control group, as
p > 0.05.
H1.4: There is a significant difference in terms of the Analysis level of students'
conceptual understanding, between students who are exposed to the Virtual
Lab environment and those who experienced traditional instruction.
Table 23 Mean Scores, Standard Deviation, and p-values of Analysis level in post-test
Group
Experimental
31
5.096
1.776
33
3.454
2.137
Controlled
* Significant at 0.05 level
Mean
Std.
3.331
0.001*
According to the results presented in table 23, the mean scores of conceptual
understanding post-test (analysis level items) for students in the experimental group
were significantly higher than those of the control group as the p < 0.05.
H2. There is a significant difference, in terms of students' science process skills,
between students who are exposed to the Virtual Lab environment and
those who experienced traditional instruction.
Table 24 Mean Scores, Standard Deviation, and p-values of science process skills
Group
Mean
Std.
Experimental
31
17.549
5.051
Controlled
33
12.848
4.124
4.088
0.000*
71
Results
As shown in table 24, the results prove that the mean scores of science processing skills
post-test for students in the experimental group were significantly higher than those of
the control group as the p < 0.05.
In order to be precise, the researcher divided the previous hypothesis into six sub
hypotheses according to the level of questions in the process skills test as follows.
H2.1: There is a significant difference in terms of the Observation skill of
students' science processing, between students who are exposed to the
Virtual Lab environment and those who experienced traditional instruction.
Table 25 Mean Scores, Standard Deviation, and p-values of Observation skill in post-test
Group
Mean
Std.
Experimental
31
3.032
1.448
Controlled
33
2.242
1.392
Experimental (F.)
18
2.889
1.567
Controlled (F.)
17
1.764
1.200
Experimental (M.)
13
3.230
1.300
Controlled (M.)
16
2.750
1.437
2.224
0.030*
2.371
0.024*
.934
0.359
72
Results
Table 26 Mean Scores, Standard Deviation, and p-values of Making Inference skill in posttest
Group
Mean
Std.
Experimental
31
3.871
1.543
Controlled
33
2.606
1.619
Experimental (F.)
18
4.000
1.680
Controlled (F.)
17
2.823
1.590
Experimental (M.)
13
3.692
1.377
Controlled (M.)
16
2.375
1.668
3.195
0.002*
2.125
0.041*
2.282
0.031*
73
Results
Table 27 Mean Scores, Standard Deviation, and P-values of Classification skill in post-test
Group
Mean
Std.
Experimental
31
3.935
1.824
Controlled
33
2.303
1.510
Experimental (F.)
18
3.777
1.800
Controlled (F.)
17
1.882
1.653
Experimental (M.)
13
4.153
1.908
Controlled (M.)
16
2.750
1.238
3.909
0.000*
3.238
0.003*
2.392
0.024*
Group
Mean
Std.
Experimental
31
3.096
1.850
Controlled
33
2.909
1.876
Experimental (F.)
18
3.000
1.847
Controlled (F.)
17
2.470
1.806
Experimental (M.)
13
3.230
1.921
Controlled (M.)
16
3.375
1.892
0.403
0.689
0.856
0.398
0.203
0.841
74
Results
According to the results presented in table 28, the mean scores of science process skills
post-test (measurement level items) for students in the experimental group were higher
than those of the control group, but statistically insignificant, as p > 0.05.
The results also show that mean scores of the post-test for female students in the
experimental group were higher than of the control group but statistically insignificant,
as p > 0.05. Same results were obtained when the same post-test was implemented on
male students, where the mean scores of male students of the experimental group were
less than those for the control group, but statistically insignificant, as p > 0.05.
Group
Mean
Std.
Experimental
31
2.580
1.478
Controlled
33
1.697
1.237
Experimental (F.)
18
2.666
1.533
Controlled (F.)
17
2.117
1.111
Experimental (M.)
13
2.461
1.450
Controlled (M.)
16
1.250
1.238
2.600
0.012*
1.206
0.236
2.428
0.022*
75
Results
Table 30 Mean Scores, Standard Deviation, and p-values of Prediction skill in post-test
Group
Mean
Std.
Experimental
31
1.612
0.803
Controlled
33
1.090
1.011
Experimental (F.)
18
1.777
0.646
Controlled (F.)
17
0.705
0.985
Experimental (M.)
13
1.384
0.960
Controlled (M.)
16
1.500
0.894
2.277
0.026*
3.826
0.001*
0.334
0.741
76
Results
Summary
Conclusion
Data illustrated in figure 18 show that:
In general, mean score of students in the experimental group was higher than
mean scores of students in the control group.
Mean score of female students of the experimental group was higher than those
of the control group in the following four skills: observation, making inferences,
classification, and prediction,
Mean score of male students of the experimental group was higher than those of
the control group in the following three skills: making inferences, classification,
and communication.
Mean score of male and female students of the experimental group was
statistically insignificant in "measurement" skill, in comparison with the
respective control group.
77
Results
between
skills
post-test
(observation,
inferring,
classification,
measurement,
communication, and prediction level items) between male students and female students
in the experimental group, was statistically insignificant, as p > 0.05.
78
Results
Table 31 Differences between male and female students of the experimental group in science
process skills post-test
Type of skill
Gender
Observation
Males
13
3.230
1.300
Females
18
2.888
1.567
Males
13
3.692
1.377
Females
18
4.000
1.680
Males
13
4.153
1.908
Females
18
3.777
1.800
Males
13
3.230
1.921
Females
18
3.000
1.847
Males
13
2.461
1.450
Females
Males
Females
18
13
18
2.666
1.384
1.777
1.533
0.960
0.646
Inferring
Classification
Measurement
Communication
Prediction
Mean
Std.
0.642
0.526
0.541
0.593
0.560
0.580
0.338
0.738
0.376
0.710
1.364
0.183
Summary
ComparisonofstudentsgenderwithinEx.Groupconcerning
eachskill
4,5
4
3,5
3
2,5
2
1,5
1
0,5
0
Males
Femals
Figure 19 Comparison of students' gender within Ex. Group concerning each skill of science
processing
79
Results
Conclusion
The results illustrated in fig. 19, reveal that there is no significance difference due to
gender effect within the experimental group in each skill of the tested six science
process skills. As a result, the null hypothesis is accepted concerning the independence
of gender against experimental treatment.
H3: There is a significant difference, in terms of students' conceptual
understanding, throughout the duration of the experiment, particularly in
the pre- and post-tests.
Table 32 Results of pre-/post-test for the experimental group in conceptual understanding
Ex. Group
Pre-test
N
31
Mean
Std.
10.580
4.693
16.129
Post-test
* Significant at 0.05 level
df
30
6.500
0.000*
4.124
Results presented in table 32 show that the mean scores of students of the experimental
group in the post-test of conceptual understanding were statistically highly significant
than the mean scores in the pre-test, as p < 0.05. The results indicate a significant
difference between scores in post-test and pre-test in favor of post-test.
H4: There is a significant difference, in terms of students' science process skills,
throughout the duration of the experiment, particularly in the pre- and posttests.
Table 33 Results of pre-/post-test for the experimental group in science process skills
Ex. Group
Pre-test
Post-test
Mean
Std.
31
11.935
4.802
17.548
4.051
df
30
4.854
0.000*
80
Results
the mean scores in the pre-test, as p < 0.05. The results indicate a significant difference
between scores in post-test and pre-test in favor of post-test.
5.2. Summary of t-test results
The summary presented in table 34, reveals that:
There is statistically significant increase in students' mean scores of the
experimental group (males and females) in the post-test in both conceptual
understanding and science processing skills.
Female students of the experimental group performed significantly better than
those in the control group in the following four skills: observation, inferring,
classification, and prediction.
Male students of the experimental group performed significantly better than those
in the control group in the following three skills: inferring, classification, and
communication.
Neither male nor female students of the experimental group performed
significantly better than those in the control group in measurement skill.
Students of the experimental group performed significantly better than those in
the control group in two cognitive levels of conceptual understanding test.
There is statistically significant increase in students' mean scores of the
experimental group in the post-test of the whole science process skills except
''measurement'' skill.
81
Results
Variable
Treatment
Control
Males
Females
SPS Skills
Observation
Inferring
Classification
Measurement
Communication
Prediction
Levels of conceptual
understanding
Knowledge
Comprehension
Application
Analysis
Hypotheses
1-
Acceptance
/Rejection
9
82
Results
3-
9/8
9/8
9/8
9
9
83
Results
45-
9
9
9
Effect size between students' scores in the experimental group and control
group in the post-test of conceptual understanding:
Calculate d and r using means and standard deviations
Cohen's d = M1 - M2 / pooled
where pooled = [( 1+ 2) / 2]
rY = d / (d + 4)
The results indicate that: Cohens d = 0.876 and Effect-size r = 0.401
The ES of 0.876 indicates that the mean of the treated group is at the 79th percentile
of untreated group (Large effect)
Effect size between students' scores in the experimental group and control
group in the post-test of conceptual understanding (knowledge level):
The results indicate that: Cohens d = 0.232 and Effect-size r = 0.115
The ES of 0.232 indicates that the mean of the treated group is at the 54th percentile
of untreated group (Small effect).
84
Results
Effect size between students' scores in the experimental group and control
group in the post-test of conceptual understanding (comprehension level):
The results indicate that: Cohens d = 0.841 and Effect-size r = 0.387
The ES of 0.841 indicates that the mean of the treated group is at the 62nd percentile
of untreated group (Medium effect).
Effect size between students' scores in the experimental group and control
group in the post-test of conceptual understanding (application level):
The results indicate that: Cohens d = 0.361 and Effect-size r = 0.177
The ES of 0.361 indicates that the mean of the treated group is at the 54th percentile
of untreated group (Small effect).
Effect size between students' scores in the experimental group and control
group in the post-test of conceptual understanding (analysis level):
The results indicate that: Cohens d = 0.835 and Effect-size r = 0.385
The ES of 0.835 indicates that the mean of the treated group is at the 66th percentile
of untreated group (Medium effect).
Effect size between students' scores in the experimental group and control
group in the post-test of science process skills:
The results indicate that: Cohens d = 1.019 and Effect-size r = 0.454
The ES of 1.019 indicates that the mean of the treated group is at the 84th percentile
of untreated group (Large effect).
Effect size between students' scores in the experimental group and control
group in the post-test of science process skills (observation):
The results indicate that: Cohens d = 0.556 and Effect-size r = 0.268
The ES of 0.556 indicates that the mean of the treated group is at the 69th percentile
of untreated group (Medium effect).
85
Results
Effect size between students' scores in the experimental group and control
group in the post-test of science process skills (inferring):
The results indicate that: Cohens d = 0.799 and Effect-size r = 0.371
The ES of 0.799 indicates that the mean of the treated group is at the 79th percentile
of untreated group (Large effect).
Effect size between students' scores in the experimental group and control
group in the post-test of science process skills (classification):
The results indicate that: Cohens d = 0.975 and Effect-size r = 0.438
The ES of 0.975 indicates that the mean of the treated group is at the 82nd percentile
of untreated group (Large effect).
Effect size between students' scores in the experimental group and control
group in the post-test of science process skills (measurement):
The results indicate that: Cohens d = 0.100 and Effect-size r = 0.050
The ES of 0.100 indicates that the mean of the treated group is at the 54th percentile
of untreated group (Small effect).
Effect size between students' scores in the experimental group and control
group in the post-test of science process skills (communication):
The results indicate that: Cohens d = 0.648 and Effect-size r = 0.308
The ES of 0.648 indicates that the mean of the treated group is at the 73rd percentile
of untreated group (Medium effect).
Effect size between students' scores in the experimental group and control
group in the post-test of science process skills (prediction):
The results indicate that: Cohens d = 0.572 and Effect-size r = 0.275
The ES of 0.572 indicates that the mean of the treated group is at the 69th percentile
of untreated group (Medium effect).
86
Results
In general, Effect sizes can also be considered as the average percentile rank of the
average treated learner relative to the average untreated learner. An ES of 0.0 indicates
that the mean of the treated group is at the 50th percentile of the untreated group. An ES
of 0.8 indicates that the mean of the treated group is at the 79th percentile of the
untreated group. An effect size of 1.7 indicates that the mean of the treated group is at
the 95.5 percentile of the untreated.
Conclusion
Bases on that effect size is an important factor for identifying the power of the research,
the results presented in fig. 20 illustrate that the dependent variables were highly
affected in two skills: inferring and classification, had a medium effect in three skills
observation, communication, and prediction, and had small effect in just only
measurement skills.
87
experimental group performed better than girls in the control group in the following
four particular skills: observation, inference, classification, and prediction. Boys of the
experimental group performed better than boys in the control group in the following
three skills: inferring, classification, and communication. Both boys and girls in the
experimental group did achieve significantly higher than their colleagues in the control
group.
One of the most important science process skills is ''observation'' which needs enormous
teaching/learning strategies in order to train young students to explore the world around
us. Therefore, good and precise preparation of teaching/learning environment is
a fundamental issue to assist students to master "observation" skill. The results of the
present research showed that using simulations through V-lab was able to allow students
of the experimental group to experience and explore different varieties of basic lab tools
through snapshot and 3D animations. Observation of basic laboratory tools throughout
visual demonstrations increased students knowledge and experience with specific tools
normally employed in basic science laboratories designed normally to facilitate
observing some of the natural phenomena related directly to students' age, interest, and
experience. The results of the present research agree well with those reported by
Furness, Winn, and Yu (1997), Yair, Mintz, and Litvak (2001), and Maldarelli et al.,
(2009). In addition, in order to get high benefit from using V-lab, teachers need to
develop their skills for designing pre environmental settings, so that, students can
effectively get acquainted with each science concept before getting involved in real
situation.
The results of the present research revealed also that, there was high tendency for
students of the experimental group to deal positively and effectively with program
activities which could be interpreted in gaining high scores in ''classification,
communication, prediction and inferring'' skills. The results indicate that V-Lab can
play a preparatory and supplementary role in developing science process skills. These
findings agree well with those reported earlier by Scheckler (2003) and Yang and Heh
(2007).
On the other hand, the obtained results showed, statistically, insignificant difference
between students of the experimental and control groups concerning the development of
''measurement'' skill as a result of implementing V-lab program. The interpretation of
89
90
statistical significant difference due to students' gender within the experimental group.
In general, gender factor has no effect on acquiring students' science process skills.
Effect size, which is considered an important issue for identifying the power of
research, was used to assess to what extent the dependent variables in the present study
were affected due to the effect of independent variable. The effect was clear for
inferring and classification skills, medium for observation, communication and
prediction skills, and small for only measurement skill. This could be attributed to
the effect of the implemented program especially on skills which need more mental
activities rather than skills which need more hands on practicing as shown by students
of the control group (practicing real lab) who scored better than V-Lab students,
however the difference was statistically insignificant (Dalgarno, 2009). These results
indicate that, science process skills which are required for scientific investigation and
always seen as the base for scientific inquiry, were developed for students in a
significant way via web based interactive learning environments encouraging them for
better understanding for the nature of science.
With respect to, effect sizes of the cognitive levels of conceptual understanding, the
results showed that, while the effect was medium on ''comprehension and analysis''
levels, it was small on ''knowledge and application'' levels. Enhancement in
''comprehension and analysis'' levels could be attributed to the effect of utilizing
computer based concept mapping and interactive activities included in V-Lab program.
The results indicated no difference in using traditional method for teaching and learning
versus using V-Lab program for ''knowledge and application'' levels. Concerning these
findings, studies conducted by Kerr et al., (2004); Lawson and Stakpole (2006); and
Mtrailler, et al., (2008) showed an equal increase in knowledge for both students in
traditional instruction and V-Lab based situation. There was no difference between both
groups of students.
The present study admits that, the use of instructional technology, within an appropriate
framework, can improve the learning process. The different aspects of using
instructional technology can engage and play a basic role in helping students to achieve
better by supporting new approaches to teaching and learning process. This emphasizes
the value of implementing web-based learning in different instructional situations.
91
These results are supported quite well by the findings of previous researchers (Bell and
Fogler, 1999; Bransford, et al., 2000; Way, 2006; and Koretsky, et al., 2008).
In light of the above findings, it should be pointed out that V-Lab had a significant
promotional function for fourth grade science learners. Some researchers found that
computer-simulated experiments could enhance active involvement in the learning
process and can improve understanding of science concepts (Bell and Fogler, 1999;
Yang and Heh, 2007; and Koretsky et al., 2008).
The results of this study may be generalized in some other private and language public
schools with comparable populations, which are similar in level and content.
6.3. Conclusions
The current study attempts to investigate previous research on V-Labs, to become aware
of previous efforts for designing such V-lab in different fields. In light of these attempts,
the researcher designed and produced a prospective V-Lab proposal supported by some
of 3D animations, to be used as an appropriate prototype for specific populations,
including the establishment of school-aged student's precise knowledge.
The study explores the relationship between ''real laboratories'', V-Labs, and research.
As shown in figure 21, laboratories could act as a framework for investigating scientific
issues of nature and life questions. Whereas V-Lab; could offer a simulation of lab tools
and major scientific concepts, including employment of science process skills. The
design was conducted through different scientific aspects and research-based
investigation.
92
Literature that focuses on the use of V-Labs suggests that students learning is
enhanced, and that students learning appeared to focus on two differing types of
learning outcomes: knowledge and skills. Studies indicate that V-Labs could be used for
various pedagogical approaches, and may re-create important roles in both classroom
and laboratory, and can take place in either classroom or at a distance. The V-Lab
environment depends on simulations that provide students with the opportunity for near
real experience and the possibility for interaction. Contribution to a conceptual
transforming is possible; V-Lab may also provide open-ended experiences and
additional tools for scientific inquiry. Concerning research on Virtual Labs, current
research investigates educational uses, strategies, means for integration into learning
situations, scientific laboratory, and estimating effect sizes. Additionally, the literature
review helped to familiarize the researcher with different models for designing and
implementation. Such research can enhance efforts to develop science education.
The findings of this study offer an approach for involving primary school students in
e-learning activities, especially web-based learning, such as the V-Lab environment that
positively affects the conceptual understanding and science process skills. In the present
study, V-Lab utilized interactive approach and simulations of scientific processes for
primary school-aged students and provided a multimedia learning environment that
motivated and encouraged students for an active form of learning, i.e. more
individualized and independent learning.
V-lab environments can play an important supplementary role in science instruction
especially in primary education. It can simulate lab objects, main concepts, and
phenomena where there is a lack of time, tools, or learning strategies and when
increasing the level of instruction to a higher cognitive level is needed. Accordingly, the
animation and graphical representations of the simulated activities enabled students to
observe the outcome of the simulated experiments. However, the role of simulations is
not expected to replace laboratory practicing, but to provide learners with the
opportunity for supplemental contact with the variables similar to real-world situations.
The results also show that the insufficient integration of conceptual understanding and
main skills is still an important issue in student education programs. It should take into
account the preparation of students in an interactive way to achieve the intended
concepts and to employ the use of necessary basic process skills.
93
94
Some limitations of the current study could be identified for further investigations.
Further research should use larger number of participants, conducted for a longer
period, and considers other integrated science process skills through designing other
models and prospective via 3D interfaces based environments, since the use of
instructional technology proved to have a significant positive effect on students
concerning concepts and basic science process skills. Therefore, the researcher
recommends that further studies could be made in order to obtain more definite results,
instead of depending on the results of just only one study. Using other measurement
instruments than those used in the current study would be important.
95
References
7. References
Adamo-Villani, N., Richardson, J., Carpenter, E., & Moore, E. (2006). A photorealistic
3D Virtual Laboratory for Undergraduate Instruction in Microcontroller
Technology. International Conference on Computer Graphics and Interactive
Techniques, Boston, Massachusetts, July 30-Augest 03, 1-5.
Ainge, D. (1996). Upper primary students constructing and exploring three dimensional
shapes: A comparison of virtual reality with card nets. Journal of Educational
Computing Research, 14(4), 345-369.
Alasaf, S. (2003). The introduction to the research in the behavioral sciences. 3rd ed.
Riyadh, Obeikan Library, 316-317.
Alberti, M. A., Marini, D. & Trapani, P. (1998). Experimenting Web Technologies to
Access an Opera Theatre. In T. Ottman & I. Tomak (Eds). Proceedings of EdMedia 98, World Conference on Educational Multimedia, Hypermedia and
Telecommunications. Charlottesville, VA: AACE, 104-110.
Alexiou, A., Bouras, C., Giannaka, E., Kapoulas, V., Nani, M. & Tsiatsos, Th. (2004).
Using VR technology to Support E-learning: The 3D Virtual Radiopharmacy
laboratory. Journal of Educational Multimedia & Hypermedia, 13(3).
Ali, M. (2001). Scientific Education and Science Teaching, Cairo. The Thinking Arab
House, 97-107.
Allagany, A. & Algmal, A. (1999). Glossary of Educational Terminologies in The
Curricula and Teaching Methods. 2nd ed., Cairo, books world, 1999, p. 7.
Anderson, G. (1998). Fundamentals of educational research. London: Falmer Press.
Anderson-Inman, L., & Zeitz, L. (1993). Computer-based concept mapping: Active
studying for active learners. Computing Teacher, 21(1), 6-11.
Barnes, Marianne B., & Foley, Kathleen R. (1999). Inquiring into Three Approaches to
Hands- on Learning in Alementary and Secondary Science Methods Courses.
Electronic Journal of Science Education, 4(2), December.
Bell, J. T. & Fogler, H. S. (1999). Virtual Laboratory Accidents Designed to Increase
Safety Awareness. American Society for Engineering Education, Annual
Meeting, Charlotte, NC, Session 3613, 1-9.
Bergerud, Marly (2008). Interactive 3D (i3D) and Simulation-Based Learning (SBL)
Revolutionize Learning, community college week, 10.
96
References
97
References
Cheng, K.W.E., Chan, C. L., Cheung, N.C. & Sutanto, D. (2002). Virtual laboratory
development for teaching power electronics, IEEE Explore, vol. (2), 461-466.
Retrieved January 6, 2009, from
http://http://ieeexplore.ieee.org/stamp/stamp.jsp?arnumber=01022496
Chittaro, L. & Ranon, Roberto (2005). Web3D technologies in learning, education and
training: Motivations, issues, opportunities. Computers & Education.
Chittleborough, G., Treagust, D., Mamiala, T. & Mocerino, M. (2005). Students'
perceptions of the role of models in the process of science and in the process
of learning. Research in Science and Technological Education, 23, 198.
Chiu, C., Huang, C., & Chang, W. (2000). The evaluation and influence of interaction
in network supported collaborative concept mapping. Computers and
Education, 34(1), 17-25.
Clark, Ruth C. (2008). E-learning and the science of instruction: proven guidelines for
consumers and designers of multimedia learning. 2nd ed., Library of Congress
Cataloging-in-Publication Data, 58-73.
Clarke, Katie (2010). A Science, Engineering and Technology (SET) Approach
Improves Science Process Skills in 4-H Animal Science Participants. Journal
of Extension, 48(1), 1-4. Retrieved July 11, 2010 from
http://www.joe.org/joe/2010february/iw3.php
Cohen, L., Manion, L, & Morrison, K. (2007). Research Methods in Education, Taylor
& Francis e-Library, (6th Ed.)
Dalgarno, B., Bishop, A., Adlong, W., & Bedgood, D. (2009). Effectiveness of a virtual
laboratory as a preparatory resource for distance education chemistry
students. Computers & Education, 53 (2009), 853-865.
Dick, W., Carey, L., & Carey, J. (2001). The Systematic Design of Instruction, (5th Ed.).
New York: Addison-Wesley Longman.
Driver, R. & Easley, J. (1978). Pupils and paradigms: A review of literature related to
concept development in adolescent science students. Studies in Science
Education, 5, 61-84.
98
References
Duschl, R., Schweingruber, H. & Shouse, A. (Eds) (2007). Taking Science to School:
Learning and Teaching Science in Grades k-8, 1st (Ed.). Committee on
Science Learning, Kindergarten through Eighth Grade. Washington, D.C. The
National Academic Press, pp. 168-185.
Egyptian Ministry of Education (Education Improving Program). (2003). Distance
teachers training program: Effective strategies and their skills in natural
science of primary school. Cairo, p. 68.
Egyptian Ministry of Education (2008): National Strategic Plan for Pre-University
Education Reform in Egypt, p. 185.
Egyptian Ministry of Education. (2009) Retrieved December 11, 2009 from
http://services.moe.gov.eg/
Esiobu, G. O., & Soyibo, K. (1995). Effects of concept and Vee mappings under three
learning modes on students cognitive achievement in ecology and genetics.
Journal of Research in Science Teaching, 32, 971-995.
Encyclopedia of Educational Technology, San Diego State University, Retrieved March
15, 2007, from http://coe.sdsu.edu/eet/articles/vrk12/index.htm
Feudner, E., Engel, C., Neuhann, I., Petermeier, K., Bartz-Schmidt, K-U., & Szurman,
P. (2009). Virtual reality training improves wet-lab performance of
capsulorhexis: results of a randomized, controlled study, Graefe's Archive for
Clinical and Experimental Ophthalmology, 247(7), 955-963.
Fontana, A. & Frey, J. H. (2000). The interview: From structured questions to
negotiated text. In N. K. Denzin & Y. S. Lincoln (Eds.), Handbook of
qualitative research (pp. 645-672). Thousand Oaks, CA: Sage Publications.
Germann, P.J. & Aram, R. (1996). Students performance on the science process skills
of recording data, analysing data, drawing conclusions and providing
evidence. Journal of Research in Science Teaching, 33, 773-798.
Gerval, J.-P. & Ru, Y. (2005). Toward a virtual lab for electronics virtual experiments.
Advanced Technology for Learning, 3 (2).
Gervasi, O., Riganelli, A., Pacifici, L.& Lagan, A. (2004). VMSLab-G: A virtual
laboratory prototype for molecular science on the Grid. Future Generation
Computer Systems, 20(5), 717-726.
99
References
100
References
101
References
Li, P., Toderick, L., & Lunsford, P. (2009). Experiencing Virtual Computing Lab in
Information Technology Education. Proceedings of the 10th ACM conference
on SIG-information technology education, Fairfax, Virginia, USA, 55-59.
Limniou, M., Papadopoulos, N. & Roberts, D. (2007). An integrated lecture, virtual
instrumentation lab approach to teaching UV-Vis spectroscopy, Educ Inf
Technol (2007) 12, 229-244.
Liu, D., Amagai, S. & Cordon, A. (2001). Development and evaluation of virtual labs
and other interactive learning tools, Biochemistry and Molecular Biology
Education, 29, 163-164.
Magistris, M. (2005). A MATLAB-Based Virtual Laboratory for Teaching Introductory
Quasi-Stationary Electromagnetics, IEEE Transactions on Education,
Feb2005. 48(1), 81-88.
Maldarelli, G., Hartmann, E., Cummings, P., Horner, R., Obom, K., Shingles, R. &
Pearlman, R. (2009). Virtual Lab Demonstrations Improve Students Mastery
of Basic Biology Laboratory Techniques, Journal of Microbiology & Biology
Education, May 2009, 10, 51-57.
Manner, Barbara M. (2003). Technology in the science classroom. In Lawrence A.
Tomei (Ed.), Challenges of teaching with technology across the curriculum:
Issues and solutions (pp. 90-95). Library of congress, Information Science
Publishing.
Marchevsky, A., Relan, A., & Baillie, S. (2003). Self-instructional virtual pathology
laboratories using web-based technology enhance medical School teaching of
pathology, Human Pathology, 34(5), 423-429.
Mayer, R. (1991). Educational psychology: A cognitive approach. Lanham, MD:
University Press of America.
Mayring, P. (2000). Qualitative Content Analysis, Forum: Qualitative Social Research,
1(2), June. Retrieved January 14, 2010, from http://www.qualitativeresearch.net/index.php/fqs/article/view/1089
Meador, K. (2003). Thinking Creatively About Science. Gifted Child Today Magazine,
26 (1), 25-29.
102
References
Menndez, L., Salaverra, A., Mandado, E., & Dacosta, J. (2006). Virtual Electronics
Laboratory: A new tool to improve Industrial Electronics Learning, IEEE
Industrial Electronics, IECON 2006 - 32nd Annual Conference, 5445-5448.
Merrill, D., Tennyson, R., Posey, L. (1992). Teaching concepts: An instructional Design
Guide, 2nd Ed., Educational Technology Publications, New Jersey, June, 6.
Mtrailler, Y. A., Reijnen, E., Kneser, C., & Opwis, C. (2008). Scientific Problem
Solving in a Virtual Laboratory: A Comparison Between Individuals and
Pairs, Swiss Journal of Psychology, 67 (2), 2008, 71-83.
Ministry of Foreign Affairs, Arab Republic of Egypt. (2009). Retrieved October 16,
2009, from http://www.mfa.gov.eg/mfa_portal/en-gb/
Mohamed, Zaher (1997). Educational Technology as philosophy and system. Cairo,
Dokki, Academic Bookshop. 1st part, 1997, p. 171.
Nance, K., Hay, B., Dodge, R., Seazzu, A. & Burd, S. (2009). Virtual Laboratory
Environments: Methodologies for Educating Cyber security Researchers,
Methodological Innovations Online, 4(3), 3-14.
Nakhleh, M. & Krajcik, J. (1993). A protocol analysis of the influence of technology on
students' actions, verbal commentary, and thought processes during the
performance of acid-base titrations, Journal of Research in Science Teaching,
30(9), 1149-1168.
Noguez, J., Huesca1, G., & Sucar, L. (2007). Shared Learning Experiences in a Contest
Environment within a Mobile Robotics Virtual Laboratory, Frontiers in
Education Conference - Global Engineering: Knowledge without Borders,
Opportunities without Passports, 2007. FIE '07. 37th Annual, 15-20.
Novak, J. & Gowin, D. (1984). Learning how to learn. Cambridge, London: Cambridge
University Press.
Oliver, K. M. (2009). An investigation of concept mapping to improve the reading
comprehension of science texts. Journal of Science Education and
Technology, 18(5), 402-414.
Ong, S. K. & Mannan, M.A. (2004).Virtual reality simulations and animations in a webbased interactive manufacturing engineering module. Computers &
Education, 43 (4), 361-382.
103
References
Ostlund, K. (1998). What the research says about science process skills. Electronic
Journal of Science Education, 2(4), 1-8.
Padilla, M. (1990). The Science Process Sills. Research matters-to the Science Teacher,
No. 9004. Retrieved June 21, 2007, from
http//:www.educ.sfu.ca/narstsite/publications/research/skill.htm
Papert, S. (1996). The connected family. New York: Longstreet Publishers.
Peterson, C. (2003). Bringing ADDIE to Life: Instructional Design at Its Best. Journal
of Educational Multimedia and Hypermedia, 12(3), 227-241. Norfolk, VA:
AACE.
Poindexter, S. E. & Heck, B. S. (1999). Using the web in your courses: What can you
do? What should you do?. IEEE Control Systems Magazine, Feb., 83-91.
Rainford, M. (1997). An evaluation of grade 7 students performance on some of the
Jamaica ROSE project science components. MA thesis, University of the
West Indies, Jamaica.
Repnik, R. & Grubelnik, V. (2010). E-Learning Materials for 3rd Grade of Primary
School-Physics, International Journal of Emerging Technologies in Learning
(iJET), 5(2), ''MIPRO 2009'', March, 43.
Rezba, J., Sprague, C. & Fiel, R. (2002). Learning and assessing science process skills.
(4th Ed.). Dubuque, IA: Kendall/Haunt Publishing Company.
Rezba, R. (1999). Teaching & Learning The Basic Science Skills: Videotape Series,
Office of Elementary and Middle School Instructional Services, Virginia
Department of Education, P.O. Box 2120, Richmond, VA 23218-2120.
Rice, M., Owies, D., Campbell, A., Snow, R., Owen, N. & Holt, D. (1999). V-Lab:
A Virtual Laboratory for teaching introductory concepts and methods of
physical fitness and function. Australian Journal of Educational Technology,
15 (2), 188-206.
Richey, R., & Nelson, W. (1996). Development research. In D. H. Jonassen (Ed.),
Handbook of research for educational communications and technology (2nd
ed.) (pp. 1213-1245). Mahwah, NJ: Lawrence Erlbaum Association.
Rong, G., Miaoliang, Z., Yabo, D., Dandan, S. & Yonggu, W. (2005). A Case study of
virtual circuit laboratory for undergraduate student courses, Information
Technology Based Higher Education and Training, July 2005, 21-24.
104
References
105
References
106
Appendices
8. Appendices
Appendix-A SPS Test
107
Appendices
108
Appendices
109
Appendices
110
Appendices
111
Appendices
112
Appendices
113
Appendices
114
Appendices
115
Appendices
116
Appendices
117
Appendices
118
Appendices
119
Appendices
120
Appendices
121
Appendices
122
Appendices
123
Appendices
124
Appendices
125
Appendices
126
Appendices
127
Appendices
128
Appendices
129
Appendices
130
Appendices
131
Appendices
132
Appendices
133
Appendices
134
Appendices
135
Appendices
136
Appendices
137
Appendices
138
Appendices
139
Appendices
140
Appendices
141
Appendices
142
Appendices
143
Appendices
144
Appendices
145
Appendices
146
Appendices
147
Appendices
148
Appendices
149
Appendices
150
Appendices
151
Appendices
152
Appendices
153
Appendices
154
Appendices
155
Appendices
Level
2-
Analysis
3-
4-
Analysis
5-
6-
Knowledge
7-
Comprehension
8-
Knowledge
9-
Comprehension
Comprehension
Analysis
156
Appendices
Skill
1-
Observation
2-
Observation
3-
4-
Classification
5-
Classification
6-
7-
Prediction
8-
Communication
9-
Measurement
10- Determine the relationship between elapsed time and time Measurement
until according to different temperature.
11- Identifying similarities and differences in features of matter Observation
cases.
12- Illustrate states of matter according to graph.
Communication
157
Appendices
Inferring
Classification
158
Appendices
159
Appendices
160
Appendices
161
Appendices
162
Appendices
163
Appendices
164
Appendices
165
Appendices
166
Appendices
167
Appendices
168
Appendices
169
Appendices
170
Appendices
Group Statistics
Group
Observation
Inferring
Classification
Measuring
Communication
Prediction
Mean
Std. Deviation
31
3,0323
1,44877 ,26021
33
2,2424
1,39262 ,24242
31
3,8710
1,54363 ,27724
33
2,6061
1,61902 ,28183
31
3,9355
1,82456 ,32770
33
2,3030
1,51007 ,26287
31
3,0968
1,85031 ,33233
33
2,9091
1,87689 ,32673
31
2,5806
1,47816 ,26548
33
1,6970
1,23705 ,21534
31
1,6129 ,80322
33
1,0909
,14426
1,01130 ,17604
Std. Error
F
Observation
,897
Sig.
,347
,348
,558
,763
,386
,019
,890
3,566 ,064
17,738 ,000
df
Sig. (2-tailed)
Mean Difference
Difference
Lower
Upper
2,224
62 ,030
,78983
,35519
,07982
1,49985
2,221
61,349 ,030
,78983
,35564
,07878
1,50089
3,195
62 ,002
1,26491 ,39594
,47343
2,05638
3,200
61,984 ,002
1,26491 ,39534
,47463
2,05519
3,909
62 ,000
1,63245 ,41762
,79765
2,46726
3,886
58,371 ,000
1,63245 ,42011
,79164
2,47327
,403
62 ,689
,18768
,46625
-,74433
1,11970
,403
61,850 ,689
,18768
,46604
-,74395
1,11932
2,600
62 ,012
,88368
,33993
,20416
1,56319
2,585
58,658 ,012
,88368
,34184
,19957
1,56778
2,277
62 ,026
,52199
,22925
,06374
,98025
2,293
60,370 ,025
,52199
,22760
,06678
,97721
171
Appendices
-5,54839
Lower
Upper
-7,29173
-3,80504
-6,500
df
Sig. (2-tailed)
30 ,000
Group Statistics
Group
Observation
Inferring
Classification
Measuring
Communication
Prediction
Mean
Std. Deviation
31
3,0323
1,44877 ,26021
33
2,2424
1,39262 ,24242
31
3,8710
1,54363 ,27724
33
2,6061
1,61902 ,28183
31
3,9355
1,82456 ,32770
33
2,3030
1,51007 ,26287
31
3,0968
1,85031 ,33233
33
2,9091
1,87689 ,32673
31
2,5806
1,47816 ,26548
33
1,6970
1,23705 ,21534
31
1,6129 ,80322
33
1,0909
,14426
1,01130 ,17604
172
Appendices
Group Statistics
Group_C
U
CU_After
Mean
Std. Deviation
Ex.
31
16,1290
3,79247 ,68115
Co.
33
12,5455
4,36671 ,76015
Group Statistics
Gender_
CU_After
Mean
Std. Deviation
EM
13
15,8462
3,60199
,99901
CM
16
13,2500
4,55339
1,13835
Group Statistics
Gender_
CU_After
Mean
Std. Deviation
EF
18
16,3333
4,01468
,94627
CF
17
11,8824
4,21133
1,02140
Group Statistics
Group_
CU
Knowledge
Mean
Std. Deviation
Ex.
31
2,9032
1,01176 ,18172
Co.
33
3,1515
1,12142 ,19521
Group Statistics
Group_
CU
Comprehension
Mean
Std. Deviation
Ex.
31
5,8065
2,08837 ,37508
Co.
33
4,1818
1,75810 ,30605
173
Appendices
Group Statistics
Group_
CU
Application
Mean
Std. Deviation
Ex.
31
2,3226
1,72022 ,30896
Co.
33
1,7576
1,39262 ,24242
Group Statistics
Group_C
U
Analysis
Mean
Std. Deviation
Ex.
31
5,0968
1,77679 ,31912
Co.
33
3,4545
2,13733 ,37206
174
Appendices
Research purpose
Research
method
Data collection
method
Result
Context
Alexiou et al.
(2004)
Present
a
virtual
laboratory.
Support collaborative
e-learning.
Descriptive
Content analysis
Produce
VR-based
laboratory accidents.
Allow students to
practice
possible
consequences
of
laboratory safety.
Descriptive
Content analysis
Bickmore
Schulman
(2009)
Development
Questionnaire
&
175
Appendices
Carnevali
Buttazzo
(2003)
&
Chen, et al.
(2008)
Cheng et al.,
(2002)
Dalgarno
et al., (2009)
Investigate
the
interaction with a
real-time system for
running
control
experiments.
Describe
the
experience in the
development of a
virtual
laboratory
environment.
Explore the effect of
simulations in a
virtual laboratory
environment on
engineering
undergraduate
students learning
achievement and
attitude.
Descriptive
Content
analysis
Experiment
knowledge test,
questionnaire
Descriptive &
Development
Questionnaire,
an online Lab
sheet.
Experiment
Tests,
questionnaire,
interviews
176
Appendices
Feudner, et al.
(2009)
Hatherly,
al. (2009)
et
Huang (2003)
Jones (2001)
Laboratory
as
a
preparatory tool for
university chemistry
students who study at
a distance.
Investigate, whether
capsulorhexis training
on the EYESi surgical
simulator improves
performance of
surgical novices.
Experiment
Observation
Descriptive
Observations
Descriptive
Student focus
groups
and
interviews
Descriptive
Student
interviews
and
177
Appendices
random phenomena
via
the
virtual
statistics. Describe the
rationale, design, and
implementation
of
online
statistics
laboratory.
Present a virtual lab
model
to
solve
number of problems
involved
in
the
educational procedure
of computer science.
Kantzavelou
(2005)
Koretsky, M.
D.
et
al.
(2008)
Lawson
Stackpole
(2006)
&
Describe the
instructional design,
implementation, and
assessment of a
virtual laboratory
based on a numerical
simulation of a
chemical vapor
deposition (CVD)
process.
Design experiments to
optimize the
performance of a
CVD reactor.
Perform virtual
experiments, analyze
and interpret the
results.
Investigate the impact
of
virtual
lab
environment
on
student achievement
and
student
satisfaction
of
a
distance delivered VLab.
final exam.
Descriptive
Content
analysis, exams
Quasiexperiment
Observation,
Task analysis
Experiment
Observations,
Formal group
interviews, and
a Likert scale
attitude online
questionnaire.
178
Appendices
Discuss the
challenges meet in
offering this virtual
experience.
Leitner
&
Cane (2005)
Provide distance
learning
Students with a
remote laboratory
experience. Providing
distance learning
students with an
effective and
satisfying laboratory
experience.
Descriptive
Content analysis
Li,
et
(2009)
al.
Descriptive
Questionnaire
Limniou et al.
(2007)
QuasiExperiment
Questionnaire
179
Appendices
laboratory.
Magistris,
(2005)
Maldarelli
al. (2009)
et
Descriptive
Questionnaire,
Content analysis
Create videos
explaining and
demonstrating a
variety of lab
techniques that would
serve as teaching tools
for undergraduate and
graduate lab courses.
Assess the impact of
these videos on
student learning.
Experiment
180
Appendices
Descriptive
Content
Analysis
Menndez, et
al. (2006)
Descriptive
Poll to verify
the satisfaction
of the students,
Exams
Mtrailler, et
al. (2008)
Investigate scientific
problem solving via
simulated lab tool as
well as, domaingeneral psychological
Knowledge.
Quasiexperiment
Pre-post test
Nance et al.
Investigates three
Descriptive
Questionnaire
181
Appendices
(2009)
unique example
implementations of
virtual environments
which represent the
field from local to
remote access lab.
Noguez, et al.
(2007)
Introduce a virtual
simulated laboratory
where the participants
train and compete.
Present a
communication model
that allows for
interaction among
participants and
observers in a
distributed
competition.
Describe Virtual Labs
as sophisticated
interactive demos and
propose them as a
good substitute of
physical labs.
Experiment
post-test,
Questionnaire
Descriptive
Documents,
data files
Describe the
development and
evaluation of a
"virtual laboratory"
(V-Lab) for
introductory practical
studies of human
structure and function
in the movement
sciences.
Descriptive
An
online
questionnaire,
telephone
interviews
Poindexter &
Heck, (1999)
Rice et
(1999)
al.
182
Appendices
al.
Scheckler
(2003)
Sommer, B. &
Sommer, R.
(2003)
Steidley
Bachnak
(2005)
&
StuckeyMickell
&
StuckeyDanner (2007)
Development
Attitudes
questionnaire,
content analysis
Give specific
guidelines for
assessing usage of
Virtual Lab.
Describe the
development and
outcome of
an online laboratory
section for a lower
division research
methods course.
Descriptive
Interview
Experiment
Open-ended
questionnaire
Design and
development of a VLab environment and
a prototype
experiment.
Allow students to
perform experiments
from remote locations
using a web browser.
Investigate student
perceptions of virtual
biology labs used in
two online
Descriptive
Content analysis
Descriptive
Online survey
183
Appendices
introductory biology
courses.
Subramanian
&
Marsic
(2001)
Present software
architecture for
development of
virtual laboratories.
Developing several
virtual
Laboratories for cell
division, virtual
microscopy, etc.
Report experience in
developing and
deploying such virtual
laboratories.
Development
Observation,
Content analysis
Summers
al. (2005)
Describe the
development and
implementation of a
virtual computer lab
for teaching online
information assurance
classes.
Providing an
opportunity for
students to do handson security
assignments.
Present evidence for
the educational
Descriptive
Transcripts
about
Students views.
Quasiexperiment
Questionnaire
to study habits
et
Swan
&
ODonnell,
184
Appendices
(2009)
and attitudes,
studentinterviews
on
usability issues
Way (2006)
Describe
the
implementation
of
designed laboratory
model to encourage
computer
science
undergraduates
to
actively
pursue
collaborative research
with other students.
Descriptive
Focus groups
Investigate
and
compare the impact of
Internet
v-physics
laboratory
(IVPL)
instruction
with
traditional laboratory
instruction
in
academic
achievement
of
physics, Performance
of science process
skills and computer
attitudes of tenth
grade students.
QuasiExperiment
Pre/Post
test,
attitudes scale
185
Declaration
Declaration
PhD Dissertation: The Impact of a Web-Based Virtual Lab on the Development of
Students' Conceptual Understanding and Science Process Skills
I herewith declare that I have produced this research without the prohibited assistance of
third parties and without making use of aids other than those specified; notions taken
over directly or indirectly from other sources have been identified as such. This study
has not previously been presented in identical or similar form to any other German or
foreign examination board.
The Dissertation work was conducted from May 2007 to October 2010 under the
supervision of Prof. Dr. Thomas Khler at faculty of Education.
I declare that I have not undertaken any previous unsuccessful doctorate proceedings.
I declare that I recognize the doctorate regulations of the faculty of Education at
Dresden University of Technology.
186
Declaration
Erklrung
gem 6, Absatz 2 der Promotionsordnung der Fakultt Erziehungswissenschaften,
Technische Universitt Dresden vom October 2010
Hiermit versichere ich, dass die vorliegende Arbeit ohne unzulssige Hilfe und ohne
Benutzung anderer als der angegebenen Hilfsmittel angefertigt wurde. Die aus fremden
Quellen direkt oder indirekt bernommenen Gedanken sind in der Arbeit als solche
kenntlich gemacht.
Bei der Auswahl und Auswertung des Materials sowie bei der Herstellung des
Manuskriptes haben mich untersttzt. Weitere Personen waren bei der geistigen
Herstellung der vorliegenden Arbeit nicht beteiligt, insbesondere wurde auch nicht die
Hilfe eines Promotionsberaters in Anspruch genommen. Dritte haben weder unmittelbar
noch mittelbar geldwerte Leistungen fr Arbeiten erhalten haben, die im
Zusammenhang mit dem Inhalt der vorgelegten Dissertation stehen.
Ich versichere, dass die vorgelegte Arbeit weder im Inland noch im Ausland in gleicher
oder in hnlicher Form einer anderen Prfungsbehrde zum Zwecke einer Promotion
oder eines anderen Prfungsverfahrens vorgelegt und auch noch nicht verffentlicht
wurde.
187