Universal Journal of Educational Research 3(9): 632-639, 2015 http://www.hrpub.org DOI: 10.13189/ujer.2015.030907 The Role of Prior Warning on Test Performance: How Effective Is It to Improve Students’ Grades? Rafiuddin Ahmed College of Business, James Cook University, Australia Copyright © 2015 by authors, all rights reserved. Authors agree that this article remains permanently open access under the terms of the Creative Commons Attribution License 4.0 International License Abstract Students’ use of test information to prepare for [see for example, 3, 4, 5]. Kelly, Conant and Smart [6] label a test in a controlled or supervised test environment has been testing as an integral part of quality teaching. The literature examined in studies outside Australia. This paper reports the on assessment in higher education reports two common types findings of the use of test information and its value, in terms of testing: multiple choice and objective/essay type tests of an improvement/decline in marks, in an actual test of an [7-9]. In any kind of testing, students are required to undergraduate subject taught at an Australian university. demonstrate certain skills and abilities. For example, Using a questionnaire survey of students, the study finds that students studying for professional accounting degrees are students overall don’t perceive test information useful, there required to demonstrate sound analytical and conceptual is no statistically significant difference in performance skills [10]. Accounting academics also endorsed this view between known and unknown questions, students’ scores [11]. improve from the use of information and in some instances While testing is an educators’ tool, tests are formal the improvements are statistically significant between credentialing methods that students are required to complete students with different characteristics. The paper contributes to earn their degrees, it is a tool for them to showcase their to our understanding of students’ willingness to use learned skills in a controlled test environment. Students’ information and the benefits of such information to study and responses to educators’ testing demands have generated a perform for improved test scores. The study has implications large body of literature in higher education context. for educators making test information available as a Students’ use of strategies to respond to test demands in preferred practice or universities using it as part of a policy to different subjects, and in different test types are empirically improve student retention rates or supplement evaluation of investigated previously [7, 8]. Quite often this test demands students’ learning. (from their instructors) is conveyed through forewarning, cues or formal communication such as sample questions, Keywords Warning, Test Performance, GLM Method, question types, and level of difficulties. The availability of Anxiety, Study Approach, Management Accounting such information is instrumental in studying for a test [1, 7, 8, 12]. Prior studies examining the effect of information or cues [13, 14] or forewarning [12] on students’ extent of 1. Introduction preparation for an exam and performance in different types of tests are diverse. Some studies have reported that the Assessment is one of the most important tools for release of information (or warning) increases anxiety levels determining student’ achievements from taught materials in [1, 8, 15] while others report that the availability of such university level subjects. A variety of achievement strategies information motivates some students [1, 13]. These studies are used in academic institutions and a variety of approaches are mainly confined to the laboratory environment and have are used to help students to optimize achievements from examined a number of subjects outside Australia. There are assessment items. This paper aims at examining the role of calls for more research into examining students’ information in students’ preparing for an examination and as performance in business subjects in actual tests in a part of an assessment policy. controlled test environment (supervised examination), in One of the most commonly used measures of educational different university contexts, for ecological validity of the outcomes is evaluation. Evaluation allows measuring generalizations in a different context and to gain insights into students’ comprehension of taught materials [1], it tells an students’ behavior in real test environments [1, 8, 12-15]. educator what and how students learn subject materials This study responds to these calls. [2].Testing is most commonly observed as an evaluation tool This study is based on the data captured from students’ Universal Journal of Educational Research 3(9): 632-639, 2015 633 final examination records of marks in a third year availability of examination information triggers anxiety in management subject taught at a university in Queensland, students. Depending on the level of anxiety, students Australia. The subject was part of a compulsory degree unit, perform accordingly (e.g. less anxious students perform offered to students enrolled in face to face delivery mode. better than anxious students). Alpert and Haber [16] Three objectives are set for this research (a) to examine observed similar findings in their study. However, Ismail and students’ perception about the value of examination Qayyum [15] observed no role of information on test information, (b) the retrospective use of examination performance of students in actual classroom setting (in actual information (cues or warning) for the preparation of the tests). They further observed that availability of information examination, and finally, (c) to gauge the efficacy of is not related to students’ examination performance at all, examination information for students grade achievements. that is, information is proven useless following the The study reports a number of findings. The first finding is completion of assessment grading. Burns [1] took this body that students don’t perceive examination information useful of the literature even further. He found that students’ test and there is no difference in perception about the usefulness anticipations and engagements are dependent on their of exam information across groups profiled by age, gender, comprehension of the information provided to them. schooling background and major. Secondly, there is no Depending on how students form expectations following the statistically significant difference between known and availability of information, they will either work hard to unknown question sets. However, in the known question set, achieve or withdraw their efforts if they feel that the there are statistically significant differences in average marks upcoming examination would be too challenging for them. within different age groups. The final finding is exam The literature reviewed above is silent on the blanket use information reduced average marks in known questions set of information for test performance. It is unclear as to the in five out of ten groups of students’ groups (age, gender, efficacy of information and its effect on actual test schooling and major). Based on these three findings, the performance. Our intention here is to explore if information major conclusion of this paper is that examination by itself is perceived useful before an examination, the information is marginally useful to majority of students to characteristics of the students who expect the information to prepare for an examination and may be worthwhile releasing prepare for the test, and finally if there are differences in to them before an examination. perceptions between students grouped by age, gender, This paper adds to the growing body of the literature in schooling background and study major. Thus, our first higher education context by offering insights into hypothesis, in alternative form, is: performance dimensions across question types, and H : Students perceive examination information useful 1a information availability for an actual examination. The study has also new dimensions to prior literature through the Following the availability of test information or the lack of inclusion of within subject (student groups) comparison of it, students prepare for an examination. The literature on the performance following the availability examination relationships between students’ test preparation strategies information. Unlike past studies, this study uses a and preparedness for test is sparse. Hakstian [7] conducted within-case (a single exam) design to compare students’ two experiments on students enrolled in an educational performances in known and unknown question sets (two research subject. The first experiment used 26 students as questions in each set). The study has enhanced the ecological subjects who were split into three treatment groups validity of generalizations reached in the prior works in this (objective, essay, and essay and objective combined). The area by corroborating the findings in prior studies [1, 7, 8, 13] students were given cues about the test format, warned about and examined empirically the concerns raised in Broekkamp the test format seven days before the test, and the exact type & Van Hout-Wolters [14] that examination information may of test questions to be expected. The study explored the be useful to prepare for an examination. relationship between students’ study approaches and The remainder of the paper is organized as follows. In the performance in different types of examinations. The findings next section the relevant research is reviewed. The research are that anticipation of test formats does not affect test setting, data and instruments used, and the results are performance, item types included, and study approaches described in the following three sections. The summary and used to study for the test. Hakstian’s [7] second study found conclusions are then elaborated. The limitations and that students stress on factual texts (perhaps problem solving) directions for future research conclude the paper. and essay tests. They observed no difference in performance in test types based on study approach adopted. Foos [8] and Weiner [17] found that students increase efforts when they 2. Review of Relevant Literature expect a difficult test than when they expect an easy test, and thus perform better in difficult tests than in an easy test. Ross, Literature on assessment and evaluation reports theory and Green, Salisbury-Glennon, & Tollefson [18] investigated the evidence of different dimensions of test performance linkage between the use of deep study strategies for items following the release of information and students’ requiring deep level study strategies and exam performance. subsequent processing of the information to prepare for an They observed that students performed better when they upcoming examination. Weber and Bizer [12] found that the expected a deep level test item and reported studying at deep 634 The Role of Prior Warning on Test Performance: How Effective Is It to Improve Students’ Grades? level for that item. The use of deep study strategy resulted in that the dependent variables of the current study are an improved grade performance. They also found that normally distributed as shown in Table 1 below. Due to students who used surface level study strategies for a surface space limitations, other values are not presented in the table. level item performed poorer than the students following deep Table 1. Normality test values* level study strategies. Fattah et al. [13] replicated this study in a psychology subject at an Egyptian university context. Dependent variables Skewness (standard Kurtosis (standard They observed the same findings. However, they have error) error) Test information -.818 (0.414) -.460 (0.809) examined study strategy as a mediating variable between test factor expectation and performance. Known questions .031 (0.414) -.890 (0.809) While the literature reviewed above is conclusive in Unknown questions -.440 (0.414) .167 (0.809) general that students adopt different study strategies, there is hardly any study that explored within a test item comparison Final examination -.249 (0.414) .417 (0.809) marks when information is released selectively for some items and *Skewness and Kurtosis Z-values between -1.96 to +1.96 represent not for the others [except 12]. Unlike Abd-El_Fattah [13] normally distributed data Cramer and Howitt [23]. and Ross et al. [18], we plan to use information as a mediating variable between students grouped by age, gender, 3.2. Instruments schooling and major and test performance in different groups of examination items. It will be quite interesting to explore if The questionnaire had 16 questions in total in four students from different socio economic backgrounds process different sections. The research instrument had sections on information differently and performance differently in an students’ demographic and personal information. The examination. Thus we have developed two hypotheses, in informed consent section of the research instrument also alternative forms, to test these premises. sought students’ permission to access their other assessment H : There are differences in average marks between items. The students were asked to rate sixteen questions on a 2a known and unknown questions five point Likert type scale (1= don’t agree at all and 5= strongly agree). The questions mainly inquired about the H : Students’ grades improve from the use of 3a students’ study approaches to preparing for the upcoming examination information final examination, their plans of studies for two different types of questions, known (by topic/chapter) and unknown questions (by topic/chapters). The personal information 3. Methods sections mainly asked for students’ age, gender, major, and prior accounting knowledge while the demographic 3.1. Sample information section asked about the students’ prior schooling, and location backgrounds. The sample for this study was drawn from students enrolled in a third year management accounting subject at a 3.3. Measurement of Variables business school in Queensland. Fifty students were enrolled in this subject, both internally and externally. An ethics We used four questions to measure warnings (or approved questionnaire was administered to the students availability of exam information) following the use of the who attended the last lecture of the semester and mailed to relationship between warning and exam performance by students who did not attend the lecture. In total 37 completed Foos [8], Ismail and Qayyum [15] and Weber and Bizer questionnaires were returned but five of these could not be (Year). As four factors are mufti-dimensional we have used for incompleteness. Thus 32 questionnaires were reduced these four factors into one factor using Principal useable for this study (64% response rate). The collected Component Analysis (PCA). The reduced factors generated responses represent a large enough sample in comparison to 32 regressions co-efficient. The alpha for this new factor is the population of students (50 in this instance). Small sample 0.76 (0.81 standardized). studies are quite common in education and evaluation We have used two separate policies on warning, unlike the literature but the data in some studies were not screened for approach used in Foos [8], Ismail and Qayyum [15], and normality tests before using the statistical procedures [see for Weber and Bizer [12]. The final exam comprised of four example, 19, 20]. We have addressed this issue to improve questions with equal weightings. It was a two hour long the inferential importance (the generalization) of this study. supervised examination. Students were not allowed to have Statistical tests require assumptions of normality of a formula sheets or notes to the examination. Following the population of observations before test statistic and classification schemes Schute [24] [see also 25], we used two procedures can be used for exact or approximate inferences sets of questions. Students were warned (cues provided) [21]. Weimer [22] and Howell [21] argue that a sample size about two questions (treatment questions) and no cues about greater than 30 is considered normal. Following these the other two questions (control questions). The profiling arguments, a number of normality tests (skewness, Kurtosis, was expected to help us understand the differences in QQ plot, and Shapiro-Wilk test) were done. We have found performance in the treatment (known questions), and control Universal Journal of Educational Research 3(9): 632-639, 2015 635 (unknown questions) compare the efficacy of warning as a co-efficient as a dependent variable of four explanatory policy on exam information disclosure for future years. variables (age, gender, major and schooling background) to Other studies in the past used warning for an entire exam [8, test four summary hypotheses. We did not find any 15], however, ours has focused on partial warning on 50% of significant relationship between perception, and age (F = the exam questions. 0.053, and p= 0.094), gender (F = 0.007, p = 0.934), The third measurement variable is the contribution of schooling (F= 0.0480, p= 0.628), and major (F= 0.046, p = information to students’ marks in different questions, and 0.833). That is, all null hypotheses are accepted, negating the thus overall performance in the test. We measured the perceived value of information in preparing for the final contribution of information by a pretest-posttest design by examination. However, further analyses were required to comparing marks before and after including information as a identify if there were differences in perceptions within co-variate, and then analyzing the differences in marks in a student-groups. The pairwise comparison in this GLM model GLM method (LSD approach). Following Fattah’s [13] (LSD approach) is summarized in Table 2 below. approach, we have explored the mediating relationship The results of the pairwise comparison in Table 2 across between information, performance and four independent all independent variables are insignificant at 5% level of variables (age, gender, schooling and major). While age and confidence. This implies students in different groups did not gender have been used in past studies [1, 24, 26], we have perceive information useful for the preparation of the added schooling background and major as two new upcoming examination. Even though the results are not variables. significant, some insights into perception differences are observed. Female students perceived information more 4. Results useful than their male counterparts. Students in other majors perceived information more useful than the students Our first hypothesis was aimed to capture students’ studying for an Accounting major. Students schooled outside perceptions about informational value of prior warning about Queensland tended to value exam information more than the nature of questions (difficult or easy) in an examination. their counterparts schooled within Queensland schooling The null hypothesis that information is not useful is accepted system. Finally, older students perceived test information at 5% level of significance (F=1.42, p=0.1556 (two tailed). more valuable than the other two groups of students (age In a GLM model, we have then used the information group 1, 18-21 years). Table 2. Perceived usefulness of information* Mean difference Variable Grouping F statistics (p value)* (p value) Gender Female vs Male 0.0507 (p= 0.781) 0.921 (p =0.352), Eta (0.058) Major Accounting vs Other major -0.436 (p= 0.439) 0.632 ( p= 0.439), Eta (0.040) 1 vs 2 -0.204 (p=0.730) Schooling 1 vs 4 -0.545 (p= 0.457) 0.297 ( p= 0.747), Eta (0.038) 2 vs 4 -0.341 (p = 0.660) 1 vs 2 0.258 (p = 0.691) Age 1 vs 3 -0.358 (p = 0.575) 0.389 (p= 0.685), Eta (0.049 2 vs 3 -0.616 (p = 0.396) *Based on GLM contrast table, Eta represents R2 Table 3. Comparison of total marks in question sets Unknown Known Variables Differences (average) (average) Age - 18-21(Group 1) 21.68 21.79 0.11 - 22-24 (Group 2) 18.00 17.85 -0.15 - 25- above (Group 3) 16.95 17.27 0.32 Schooling - Local (Group 1) 18.94 18.83 -0.11 - Within Queensland (Group 2) 20.41 20.60 0.19 -Outside Queensland (Group 3) 18.25 18.62 0.37 Gender - Female 18.93 18.14 -0.79 - Male 19.61 19.53 -0.08 Major - Accounting (Group 1) 19.05 19.24 0.19 - Other Major (Group 2) 19.51 19.41 -0.10 636 The Role of Prior Warning on Test Performance: How Effective Is It to Improve Students’ Grades? 4.1. Marks in Two Question Sets Comparison of average marks of students in different schooling groups revealed a statistically significant We have used a paired sample t-test for known questions difference in marks at 5% level of significance (F= 9.475, p = set (questions 1 and 3) and unknown questions set (questions 0.001, reliability measures, Eta squared = 0.404 and the 2 and 4). The null hypothesis is accepted at 5% level (1.20, p observed power = 0.966). The pairwise comparison (LSD =0.20). We have cross validated the calculations using a method) revealed significant differences in mean scores one-way ANOVA. In our ANOVA, the null is also accepted between schooling groups 1 and 2 (7.901, p = 0.000) and at 5% level of significance (F = 1.05, p= 0.309). We used the schooling groups 2 and 3 (7.246, p= 0.000). The students GLM method to compare the average marks in unknown and educated locally performed best within the three groups. We known questions sets. The pairwise comparison in this GLM did not find any significant difference in mean scores model (LSD approach) is summarized in Table 3. between students in groups 1(locally schooled students and 2 In the known questions set (questions 1 and 3), we have (outside locality but within the state schooled students) found statistically significant differences in mean scores (0.656, p = 0.602). between age groups 1 (18-21 years) and 3 (25 years and Comparison of marks by students’ major did not explain above) (F= 4.763, p = 0.017) and high degree of reliability of differences in marks (F = 0.072, p = 0.79), small values of the differences (eta squared= 0.268 and observed power = reliability tests also confirmed this (Eta squared = 0.002 and 0.744). The overall schooling background revealed the observed power =0.058). Between subject (accounting vs statistically significant mean difference between (5.447, p = other majors) comparison revealed no significant differences 0.035). We have also observed significant mean differences between accounting (group 1) and other majors (group 2) between students schooled locally (group 10 and within the (F=-0.410, p= 0.790). The finding is quite interesting in that university’s location state (group 2) (mean difference = students doing either a double major or other major scored 2.325, significant at 0.10 level p = 0.088). slightly higher than the students studying for an accounting Comparison of marks by students’ study majors did not major. Comparison of gender did not reveal any significant reveal any difference in marks within different student differences in marks (F = 1.183, p = 0.286), small values of groups. The differences in marks between students in group 1 (Accounting major) and group 2 (other major including reliability statistics confirmed this finding (Eta squared = double major) were statistically insignificant (F = 0.078, p= 0.0039 and the observed power is 0.183). The pairwise 0.782) and had poor reliability measures (Eta squatted= comparison revealed no significant differences in mean 0.003). The pairwise comparison (LSD method) revealed no scores between the students in group 1 (male) and group 2 significant differences in mean scores (p = 0.782 and mean (female) (difference= -1.612, p= 0.286). The finding is quite difference of -0.386). The finding revealed students doing interesting in that male students outperformed female either a double major or other majors scored slightly higher students (1.612 differences in favor of male students) in the than the students studying for an accounting major. unknown question set. Comparison of marks by gender revealed no significant difference at 5% level (F = 0.039, p= 0.844). The pairwise 4.2. The Effect of Information comparison (LSD method) revealed no significant differences in mean scores between male and female We determined the impact of information on students’ students at 5% level of significance (p = 0.844, mean performance in the known questions (treatment) by difference of 0.271). Female students outperformed male comparing marks before and after the release of the test students in the known questions. information. The table above shows that when information is In the unknown question set (questions 2 and 4), no used as a covariate, students’ marks in known questions significant difference in average marks between age groups differed significantly at 5% level by students’ age groups (F= were found. Marks of students in age group 1 (18-21 years) 5.103, p= 0.022, R2 = 0.422). Marks in other three and 3 (25 years and above) did not differ significantly (F= dimension of the students’ profile did not differ significantly 2.026, p = 0.151, reliability statistics, eta squared= 0.126 and at all. However, the marks differed between different groups observed power = 0.382). Marks by age groups did not differ within these student groups (gender, schooling and major). either, mean difference between age groups 1 and 2 was Table 4 below summarizes the results. 2.822 (p =0.109), groups 2 and 3 was -0.038 (p= 0.985) and As no specific information was released for unknown groups group 1 and 3 was 2.784 (p = 0.124). Though the questions, no comparison was made to determine the effect differences are not significant between the groups, group 1 of information in unknown questions. It is highly unlikely to (age 18-21), age group 2 (21-25 years) and 3 (25 years and have any significant influence of information on students’ above) achieved highest marks in descending order. marks. Universal Journal of Educational Research 3(9): 632-639, 2015 637 Table 4. Effect of information on known questions Net change Total marks Total marks Gains/Losses Variables (information (Before info) (After info) in marks effect) Age 18-21(Group 1) 21.68 21.79 0.11 Gained 22-24(Group 2) 18.00 17.85 -0.15 Lost 25- (Group 3) 16.95 17.27 0.32 Gained Schooling Local (Group 1) 18.94 18.83 -0.11 Lost Within Queensland (Group 2) 20.41 20.60 0.19 Gained Outside Queensland (Group 3) 18.25 18.62 0.37 Gained Gender Female 18.93 18.14 -0.79 Lost Male 19.61 19.53 -0.08 Lost Major Accounting (Group 1) 19.05 19.24 0.19 Gained Other Major (Group 2) 19.51 19.41 -0.10 Lost 5. Summary and Conclusions than the actual use of information was represented in the statistical results. This study was aimed to examine the role of warning in In order to get further insights, achievement marks in the form of disclosure of test information. We have observed known (treatment) and unknown (control) questions sets from past studies that students ask for examination were compared and contrasted independently. The key information in the belief that such information may help finding was that marks did not differ between the control and them to prepare for an examination and also help them to treatment groups (null accepted); however, pairwise choose appropriate study strategies, that is, deep versus comparison revealed differences in marks between groups in surface approaches. these two types of question sets. Younger students aged Our first objective was to determine if students perceive between 18-21 years (group 1) achieved the highest marks, warning useful for developing study strategies for an followed by students aged between 21-25 years (group two) upcoming final examination. The finding was that students and students aged 25 and above (group 3). Thus, the overall did not perceive examination warning useful to prepare for conclusion is there is a negative relationship between age an examination. Even though students demand for and achievement marks, that is, as the students grow older, examination information, and the institution where this their marks in an exam can decline. This may be attributed to research is conducted has no formal policy on warning, we students’ declining abilities to grasp new concepts and ideas have conducted this research to test the real efficacy of with the aging process. We have also explored the warning (information about the final exam) on examination relationship between major and marks achieved in control performance. The study also finds that there are no and treatment groups and observed no significant effect of differences in perceptions between students grouped by age, major on marks. However, the pairwise comparisons gender, major and prior schooling background. Therefore, revealed students doing a double major outperformed the conclusion is that even though students demand mainstream accounting major students. In the subject, information about an upcoming test, the findings from the students’ from five different double major or double degrees responses contradicted their claims for specific examination were enrolled. It may the aptitude of these students that guidelines. The students may have possessed the information contributed to a slight difference in marks in favor of other from the lecturer but may have ignored the information majors. When schooling and marks were compared, significantly, or it may be that the disclosed test items are significant differences by schooling background were difficult to comprehend in a controlled, timed exam setting, observed. Students from out of Queensland performed worst and also difficult to solve. Two of the known questions are followed by students from within the Queensland but outside taken from topics requiring higher order thinking and the location of the University school catchment areas. The comprehension skills, and the use of deep level of study students from the local school suburbs (about 100 square strategy. As the survey instruments were filled in before Kilometer) achieved the highest marks. Finally, our analysis taking the actual examination, students’ willingness rather revealed no statistically significant difference in marks 638 The Role of Prior Warning on Test Performance: How Effective Is It to Improve Students’ Grades? between male and female students in both types of question 6. Limitations and Further Research sets. However, the pairwise comparison revealed female This research is based on a study of a single subject taught students outperforming male students in both known and the at an Australian university. Therefore, the generalization unknown segments of the exam. The female students usually applies to one subject area only. Samples can be drawn from worked harder in the subject, they attended most of the classes with larger enrolments (e.g. first year Accounting, lectures, attempted most of the tutorial questions and other Business Statistics etc. where at least 200 students normally directed studies. These factors may have contributed to their enroll in any academic year) to replicate this study and higher marks. explore the reliability and validity of the conclusions reached The final objective of this study was to examine the effect of information on students’ marks. Comparison of marks in this paper. Financial Accounting and Business Statistics before and after the inclusion of information (as a co-variate) taught at the institution where this research was carried out revealed age as the only group to have statistically have similar curriculum and rigor. Only four questions on significant different performance across different age groups. students’ willingness to use test information were used to test The pairwise comparison revealed five out of ten groups had the efficacy of information use. More questions can be added improvements in marks after the effect of information was to overcome the shortcomings of limited number of considered in the calculations. The average marks of questions used here. We have examined the effect of test statistically significant different marks before and after the information on students’ anxiety levels and possible inclusion of information effect was reduced from two to only responses (motivation to study or withdrawal from studies), one group of students (by age groups). However, overall, and test performance. Other variables may be included to there were absolute marks improvements in five groups and explain the reasons for differing test performance of different reduction in marks in the other five groups, and the student groups used in this study. differences in marks were reduced after the effect of Only test of proportions, t-tests and one-way ANOVA information was considered in the calculations. tests were performed. The use of other statistical tests such as Thus, we can infer that information (though very general) a regression analysis, ANCOVA or MANCOVA may be helped the students to study for the test and helped the used in future studies to improve the reliability and validity students improve. It may be the students were less anxious of the results reported in this paper. The release of after the receipt of information or were able to focus on information to students is used as a proxy for students’ actual important text material or that they used the examination use of examination information which was not followed up guidelines seriously to study for the test. Even though the by another survey. It may be worthwhile following up the first hypothesis did not reveal significant differences in actual use of information after the completion of grading the willingness to use test information, the students indeed used exam. Finally, the study can be replicated in other grade the information to study for the test, the comparison of marks levels such as first year, second year or post graduate levels before and after the inclusion of information effect for further insights into students’ actual and intended use of (co-variate) confirmed this. The marks in the later (control) such information. established that information about a test (cues or warning) made a difference to students’ marks. Thus, the finding contradicts earlier works of Foos [8], Ismail and Qayyum Acknowledgements [15], Weiner [17] that information does not make a difference to students’ performances, and empirically This paper is an ethics approved research project validates the theoretical work of Weber and Bizer [12] that conducted by the author (Ethics Approval # H4872). An examination information is somehow useful to students. earlier version of this paper was presented at the weekly This paper adds to the current body of the literature in seminar of James Cook University and benefited from the three different ways. First of all unlike prior studies, the constructive comments from the participants at the seminar. current study explores the role of warning or cues as an The paper was also presented at the 29 WBI Conference held independent construct. The objective was to gauge the in Sydney (24-25 November 2015) and benefited from the students’ willingness to use cues or warning to prepare for a constructive comments from Professor Lewlyn Lester Raj test. The second contribution is unique in that unlike prior Rodrigues. studies, we have grouped the questions of a final examination into two groups, by the availability of information, a known question set and an unknown question set, each set comprising of two questions. Comparison of marks of students grouped by major, gender, schooling REFERENCES background and age revealed students’ performances and differences in marks in known and unknown questions. [1] Burns, D.J., Will I Do as Well on the Final Exam as I Expect? An Examination of Students' Expectations. Journal of the Finally, we have shown that information can be quantified Scholarship of Teaching and Learning. 8(3): p. 1-19. 2008 and its effect on students’ can be determined (in absolute terms) which may be useful for teaching and assessment [2] Lewis, R., P. Berghoff, and P. Pheeney, Focusing Students: practices. three approaches for learning through evaluation. Innovative Universal Journal of Educational Research 3(9): 632-639, 2015 639 Higher Education. 23(3): p. 181-196. 1999 tests. Educational Psychology Review. 19(4): p. 401-428. 2007 [3] Souchal, C., et al., Assessing does not mean threatening: The purpose of assessment as a key determinant of girls' and boys' [15] Ismail, Z. and R. Qayyum, The effects of immediate performance in a science class. British Journal of Educational forewarning of test difficulty on test performance in applied Psychology. 84(1): p. 125-136. 2014 educational context. International journal of business and social science. 2(1): p. 132-139. 2011 [4] Veldhuis, M., et al., Teachers’ Use of Classroom Assessment in Primary School Mathematics Education in the Netherlands. [16] Alpert, R. and R.N. Haber, Anxiety in academic achievement Cadmo. 2013 situations. The Journal of Abnormal and Social Psychology. 61(2): p. 207. 1960 [5] Crooks, T.J., The impact of classroom evaluation practices on students. Review of Educational Research. 58(4): p. 438-481. [17] Weiner, B., Human motivation: Metaphors, theories, and 1988 research: Sage.1992 [6] Kelley, C., J. Conant, and D. Smart, Examination procedures [18] Ross, M.E., et al., College students' study strategies as a in marketing education: Profiling marketing’s master teachers. function of testing: An investigation into metacognitive Developments in marketing science: p. 263-267. 1989 self-regulation. Innovative Higher Education. 30(5): p. 361-375. 2006 [7] Hakstian, A.R., The effects of type of examination anticipated on test preparation and performance. The Journal of [19] Oxford, R., et al., Factors affecting achievement in a satellite Educational Research: p. 319-324. 1971 delivered Japanese language program. American Journal of Distance Education. 7(1): p. 11-25. 1993 [8] Foos, P.W., Test performance as a function of expected form and difficulty. The Journal of Experimental Education. 60(3): [20] Howsen, R.M. and S.E. Lile, A comparison of course delivery p. 205-211. 1992 methods: An exercise in experimental economics. Journal of Economics and Finance Education. 7(1): p. 21-28. 2008 [9] Scouller, K.M. and M. Prosser, Students experiences in studying for multiple-choice question examinations. Studies [21] Howell, D., Statistical methods for psychology: Cengage in Higher Education. 19(3): p. 267-279. 1994 Learning.2013 [22] Weimer, R.C., Statistics. Dubuque, IA: Wm. C, 1993, Brown [10] Anderson, A., Perspectives on education: Capabilities for Publishers. success in the accounting profession.1989 [23] Cramer, D. and D.L. Howitt, The Sage dictionary of statistics: [11] Sundem, G.L., The accounting education change commission: a practical resource for students in the social sciences: Its history and impact: Accounting Education Change Sage.2004 Commission and American Accounting Association.1999 [24] Shute, G.E., Accounting Students and Abstract Reasoning: [12] Weber, C.J. and G.Y. Bizer, The effects of immediate An Exploratory Study: a Research Report: American forewarning of test difficulty on test performance. The Accounting Association Sarasota, Florida.1979 Journal of general psychology. 133(3): p. 277-285. 2006 [25] Davidson, R.A., Relationship of study approach and exam [13] Abd-El-Fattah, S.M., The effect of test expectations on study performance. Journal of Accounting Education. 20(1): p. strategies and test performance: a metacognitive perspective. 29-44. 2003 Educational Psychology. 31(4): p. 497-511. 2011 [26] Beyer, S., Gender differences in the accuracy of grade [14] Broekkamp, H. and B. Van Hout-Wolters, Students' expectancies and evaluations. Sex Roles. 41(3-4): p. 279-296. adaptation of study strategies when preparing for classroom 1999