大学英语新旧四级对比研究——2006年6月试卷个案分析

VIP免费

3.0 陈辉 2024-11-19 8 4 1.36MB 117 页 15积分

侵权投诉

摘要

作为国内最大规模的英语测试，大学英语四六级考试已经问世二十多年。在此

期间，关于它的争论和改革从来都没有停止过。最近的一次改革更是影响重大且意

义深远，同时此次改革也带来了激烈的争论。自从 2004 年教育部公布了大学英语

课程教学要求（试用），四六级的改革便随之开始。到 2006 年六月，新的四级正式

出现，并在全国 180 所试点学校举行。从此，出现了大量关于大学英语新四级的文

章。然而，却鲜有文章对新旧四级进行全方位的对比研究，尤其是关于新四级的具

体效果的文章。鉴于此，作者进行此研究对新旧四级进行全面的对比。

作者采用的研究工具包括新旧四级两套试卷，一张调查问卷，以及一份英语水

平学生自评表。所选取的试卷为 2006 年六月同时进行的新旧两套四级真题试卷，

实验对象为河南财经学院随机选取的一年级两个班级的学生。研究数据主要来源于

实验对象对问卷的回答，学生自评表的结果，和两次测试中学生所取得的成绩。作

者使用包括信度分析、关联度分析和 t检验等方法在内的多种统计分析方法对数据

进行分析，得出如下结论：

第一、两次测试结果的相关性低。结合新旧四级题型及各部分分值的不同分析

表明，与旧四级相比新四级所测试的能力发生明显变化，学生成绩亦发生比较显著

的变化。

第二、问卷调查显示学生偏爱客观题型，然而通过主客观题型的得分情况分析，

此种偏好对主客观题的得分率不具显著影响。

第三、作文施考程序的变化对学生作文成绩有显著影响：在新四级中，作文是

第一项测试，学生易于发挥出更好水平。

第四、调查问卷与测试结果均表明，学生对新增快速阅读和翻译题型能较好适

应，得分率较高。

第五、通过项目分析，作者发现新旧四级中的听力测试均存在问题，有较多题

目的信度较低，难度和区分度不尽恰当。新四级中完型填空整体质量较高，优于旧

四级。

论文最后，作者在以上结论的基础上，对大学英语四级的进一步完善提出了自

己的看法。然而，由于现实原因和作者能力所限，此研究远非完善，诸多问题有待

进一步的研究和探讨。本项研究权当抛砖引玉，作者衷心希望语言教学和测试界专

家学者能在该领域开展更广泛深入的研究，共同促进中国大学英语教学的发展。

关键词：大学英语四级考试信度建构效度对比研究

ABSTRACT

College English Test (CET), as one of the largest English tests in China, has been in

existence for more than two decades, during which period debates over it and reforms of

it have been constantly going on. The recent reform is the most fundamental, but with

heated debates around as ever. Since the issue of the College English Curriculum

Requirements (for trial implementation) in 2004, reform on CET has been under way. In

June 2006, the new CET-4 made its first appearance, and was carried out in the 180

selected trial schools. Hereafter, articles about the new CET-4 have been proliferating.

However, a comprehensive comparability study between the new CET-4 and the old one

has seldom been carried out, especially on the true effects it brings. Hence, the author

attempts to conduct the present research.

To conduct this comparability study, the author adopted such instruments as two test

papers, a questionnaire, and a rating scale. The test papers of June 2006 were chosen for

the prototype tests, and two classes of first-year students of Henan University of Finance

and Economics were chosen as sample subjects. Based on the subjects’ responses to the

questionnaire and rating scale, and their performances of the two sample tests, various

statistical analyses were carried out, including reliability analysis, correlation analysis,

and paired-samples ttests, etc., on the basis of which the following conclusions were

drawn:

First, results of the two tests bear little correlation. With a view to the changes in

contents and weighting, it can be said that the abilities tested have changed to a big

extent, which will affect test performance of students with different abilities.

Second, the questionnaire survey shows that students have a strong preference to

objective test tasks, but this preference doesn’t affect their actual performances

significantly in these two types of tasks: subjective and objective.

Third, the change of procedure of Writing has a big influence upon students’ mind,

and students tend to render better performance in Writing when it is processed in the

beginning of the test which is the case of the new CET-4.

Fourth, the questionnaire and test results show that students are used to the newly

added Skimming and Scanning and Translation.

Fifth, it is found out through item analysis that Listening Comprehension of both

tests has big problems in terms of reliability, facility value and discrimination index.

Cloze of the new CET-4 is better than that of the old one in that fewer items are

problematic.

At the end of the dissertation, the author puts forward his recommendations for the

improvement of the new CET-4 on the basis of the above conclusions. However, this

study is far from perfect due to practical reasons and limitation of the author’s ability.

The author sincerely hopes that experts of language teaching and testing will conduct

deeper and more extensive study in this field so as to make contribution for the

improvement of CET and the development of College English education in China.

Key Words: College English Test Band Four, Reliability, Construct

Validity, Comparability Study

Contents

Acknowledgements

摘要

ABSTRACT

List of Acronyms………………………………………………………………………….i

List of Tables………………………………………………………………………………ii

List of Figures……………………………………………………………………………..v

Chapter One Introduction .................................................................................................... 1

§1.1 Significance of the Study ....................................................................................1

§1.2 Configuration of the Study ................................................................................. 3

Chapter Two Literature Review .......................................................................................... 5

§2.1 College English Teaching Syllabus and College English Test ........................... 5

§2.1.1 History of College English Teaching Syllabus .........................................5

§2.1.2 History of College English Test ................................................................8

§2.2 Fundamentals of Language Testing ..................................................................10

§2.2.1 Development of Language Testing .........................................................10

§2.2.2 Types of Language Tests .........................................................................11

§2.3 Essence of College English Test.......................................................................16

§2.3.1 Nature ..................................................................................................... 16

§2.3.2 Characteristics ........................................................................................ 17

§2.3.3 Construct ................................................................................................ 19

Chapter Three Study Bases ............................................................................................... 21

§3.1 Theoretical Bases ..............................................................................................21

§3.1.1 Test Usefulness ....................................................................................... 21

§3.1.2 Communicative Language Ability ..........................................................23

§3.1.3 A Framework of Test Method Facets……………………………...…..25

§3.1.4 The Comparability-oriented Model ........................................................26

§3.2 Empirical Bases ................................................................................................27

§3.2.1 The Old CET-4 ....................................................................................... 27

§3.2.2 The New CET-4 ......................................................................................29

§3.3 Features to Concern in the Present Study .........................................................30

Chapter Four Comparability Study ................................................................................... 32

§4.1 Study Operation ................................................................................................32

§4.1.1 Subjects .................................................................................................. 32

§4.1.2 Instruments ............................................................................................. 32

§4.1.3 Data Collection .......................................................................................33

§4.2 Data Analysis ....................................................................................................34

§4.2.1 Study on Questionnaire Survey .............................................................. 34

§4.2.2 Study on Test Content and Format ......................................................... 36

§4.2.3 Study on Test-taker Performance ........................................................... 38

§4.2.4 Study on the Self Rating Scale ............................................................... 66

Chapter Five Conclusions and Recommendations ............................................................ 70

§5.1 Study Results .................................................................................................... 70

§5.2 Limitation of the Study .....................................................................................70

§5.3 Recommendations on CET-4 Development ..................................................... 71

§5.4 Further Research ...............................................................................................71

Bibliography…………………………………………………………………...…….…..73

Appendix I Questionnaire ..................................................................................................73

Appendix II Self-Assessment/Peer Assessment Form of Students’ English Competence 76

Appendix III New CET Test Paper of June 2006 and Key ............................................... 79

Appendix IV Old CET Test Paper of June 2006 and Key……………………………..93

在读期间公开发表的论文 ............................................................................................. 107

List of Acronyms

AIID Alpha If Item Deleted

CET-4 College English Test Band Four

CITC Corrected Item-Total Correlation

CLA Communicative Language Ability

COM Comparability-oriented Model

DI Discrimination Index

FV Facility Value

MET Matriculation English Test

RVr1/r2 Result of Part V from Rater One/Two

SD Standard Deviation

SR Self Rating

SRS Total Score of Self Rating

SRn Total Score of Self Rating on Listening, Reading, Writing, and Translation

SRo Total Score of Self Rating on Listening, Reading, and Writing

SRL Score of Self Rating on Listening

SRS Score of Self Rating on Speaking

SRR Score of Self Rating on Reading

SRW Score of Self Rating on Writing

SRT Score of Self Rating on Translation

TMF Test Method Facet

T1 Test One (New CET-4)

T1Rt Test One Reading Comprehension (Total)

T1S Test One Subjective Part

T2 Test Two (Old CET-4)

List of Tables

Table 3.1 Content Table for the Old CET-4…………………………………………...27

Table 3.2 Content Table for the New CET-4…………………………………………….29

Table 4.1 Results of Questionnaire Survey I…………………………………………....34

Table 4.2 Descriptive Statistics of MET…………………………………………………34

Table 4.3 Results of Questionnaire Survey II……………………………………………35

Table 4.4 Reliability coefficients of the two tests………………………………………38

Table 4.5 Inter-rater reliability of the new CET-4 Writing………………………………39

Table 4.6 Inter-rater reliability of the subjective part of the new CET-4 Skimming and

Scanning…………………………………………………………………………………39

Table 4.7 Inter-rater reliability of the new CET-4 Dictation…………………………….40

Table 4.8 Inter-rater reliability of the new CET-4 Translation………………………….40

Table 4.9 Table 4.5 Inter-rater reliability of the old CET-4 Writing……………………40

Table 4.10 Descriptive statistics of the new CET-4……………………………………41

Table 4.11 Descriptive statistics of the old CET-4…………………………………….41

Table 4.12 Paired-samples ttest between the total scores of the new and old CET-4…41

Table 4.13 Correlation table between the total scores of the new CET-4 and the old

CET-4………………………………………………………………………42

Table 4.14 Correlation table of different sections and the total score within the new

CET-4…………………………………………………..…………………..43

Table 4.15 Correlation table between different tasks of the Reading in Depth and

Cloze…………………………………………………………………..……44

Table 4.16 Correlation table of different sections and the total score within the old

CET-4………………………………………………………………………44

Table 4.17 Correlation Table of Writing between the new and the old CET-4……….45

Table 4.18 Correlation Table of Listening between the new and the old CET-4……….46

Table 4.19 Correlation Table of Cloze between the new and the old CET-4…………46

Table 4.20 Correlation between the old CET-4 Reading Comprehension and Reading in

Depth of the new CET-4………………………………………………….47

Table 4.21 Correlation between the old CET-4 Reading Comprehension and Section B of

Reading in Depth of the new CET-4………………………………………47

Table 4.22 Correlation between the old CET-4 Reading Comprehension and the whole

iii

Reading Comprehension of the new CET-4………………………………47

Table 4.23 Paired-samples ttest between Writing and Cloze of the new and old

CET-4………………………………………………………………………48

Table 4.24 Descriptive statistics of the subjective section of the old CET-4……………49

Table 4.25 Descriptive statistics of the subjective section of the new CET-4…………..50

Table 4.26 Descriptive statistics of the objective section of the old CET-4……………51

Table 4.27 Descriptive statistics of the objective section of the new CET-4……………51

Table 4.28 Reliability of the new CET-4 Listening Comprehension……………………53

Table 4.29 Item-total statistics of the new CET-4 Listening Comprehension…………53

Table 4.30 Reliability of the new CET-4 Listening Comprehension with Item 11, 13, 14,

15, 17, 20, 23, 26, 29, and 32 deleted…………………………………….54

Table 4.31 Item-total statistics of the new CET-4 Listening Comprehension with Item 11,

13, 14, 15, 17, 20, 23, 26, 29, and 32 deleted………………………………54

Table 4.32 Reliability of the old CET-4 Listening Comprehension……………………54

Table 4.33 Item-total statistics of the old CET-4 Listening Comprehension……………55

Table 4.34 Reliability of the old CET-4 Listening Comprehension with Item 4, 6, 7, 12,

13, 14 and 16 deleted………………………………………………………55

Table 4.35 Item-total statistics of the old CET-4 Listening Comprehension with Item 4, 6,

7, 12, 13, 14 and 16 deleted………………………………………………..56

Table 4.36 FVs of the MCQ of new CET-4 Listening…………………………………57

Table 4.37 FVs of the MCQ of old CET-4 Listening…………………………………..58

Table 4.38 Scale for DI to assess item quality…………………………………………..59

Table 4.39 DIs of the new CET-4 Listening items………………………………………59

Table 4.40 DIs of the old CET-4 Listening items……………………………………….59

Table 4.41 Reliability of the new CET-4 Cloze…………………………………………60

Table 4.42 Item-total statistics of the new CET-4 Cloze………………………………60

Table 4.43 Reliability of the new CET-4 Cloze with Item 78 deleted…………………61

Table 4.44 Item-total statistics of the new CET-4 Cloze with Item 78 deleted…………61

Table 4.45 Reliability of the old CET-4 Cloze…………………………………………..62

Table 4.46 Item-total statistics of the old CET-4 Cloze……………………………….62

Table 4.47 Reliability of the old CET-4 Cloze with Item 76, 78 and 85 deleted………62

Table 4.48 Item-total statistics of the old CET-4 Cloze with Item 76, 78 and 85

deleted………………………………………………………………………63

Table 4.49 Reliability of the old CET-4 Cloze with Item 76, 78, 85 and 75 deleted……63

Table 4.50 Item-total statistics of the old CET-4 Cloze with Item 76, 78, 85 and 75

deleted……………………………………………………………………....63

Table 4.51 FVs of the new CET-4 Cloze items……………………………………….64

Table 4.52 FVs of the old CET-4 Cloze items………………………………………….65

Table 4.53 DIs of the new CET-4 Cloze items…………………………………………65

Table 4.54 DIs of the old CET-4 Cloze items……………………………………………65

Table 4.55 Descriptive Statistics of the Self-rating Results……………………………66

Table 4.56 Correlation between the self-rating results and the results of the new

CET-4……………………………………………………………………....67

Table 4.57 Correlation between the self-rating results and the results of the old CET-4..67

Table 4.58 Correlation on listening between the self-rating result and that of the two

tests…………………………………………………………………………68

Table 4.59 Correlation on reading between the self-rating result and that of the two

tests…………………………………………………………………………68

Table 4.60 Correlation on writing between the self-rating result and that of the two

tests……………………………………………………………..…………..69

Table 4.61 Correlation on translation between the self-rating result and that of the new

CET-4…………………………………………………………………...….69

List of Figures

Figure 3.1 Components of Communicative Language Ability in Communicative

Language Use……………………………………………………………..23

Figure 3.2 Components of Language Competence……………………………………24

Figure 3.3 The Comparability-oriented Model…………………….………………….26

Figure 4.1 Score distribution of the subjective section of the old CET-4……………….49

Figure 4.2 Score distribution of the subjective section of the new CET-4…………….50

Figure 4.3 Score distribution of the objective section of the old CET-4………………51

Figure 4.4 Score distribution of the objective section of the new CET-4…………….52

文档加载中……请稍候！
如果长时间未打开，您也可以点击刷新试试。

下载文档到电脑，查找使用更方便

15 积分 4人已下载

立即下载 VIP免费下载

摘要：

摘要作为国内最大规模的英语测试，大学英语四六级考试已经问世二十多年。在此期间，关于它的争论和改革从来都没有停止过。最近的一次改革更是影响重大且意义深远，同时此次改革也带来了激烈的争论。自从2004年教育部公布了大学英语课程教学要求（试用），四六级的改革便随之开始。到2006年六月，新的四级正式出现，并在全国180所试点学校举行。从此，出现了大量关于大学英语新四级的文章。然而，却鲜有文章对新旧四级进行全方位的对比研究，尤其是关于新四级的具体效果的文章。鉴于此，作者进行此研究对新旧四级进行全面的对比。作者采用的研究工具包括新旧四级两套试卷，一张调查问卷，以及一份英语水平学生自评表。所选取的试卷为2...

展开>> 收起<<

大学英语新旧四级对比研究——2006年6月试卷个案分析.pdf

共117页,预览10页

还剩页未读，继续阅读

大学英语新旧四级对比研究——2006年6月试卷个案分析

相关推荐

开通VIP享超值会员特权

作者详情

相关内容

推荐作者

热门标签

举报选择: