Stages and Activitiesin Language Test Development12页word.docx
- 文档编号:7008703
- 上传时间:2023-01-16
- 格式:DOCX
- 页数:5
- 大小:19KB
Stages and Activitiesin Language Test Development12页word.docx
《Stages and Activitiesin Language Test Development12页word.docx》由会员分享,可在线阅读,更多相关《Stages and Activitiesin Language Test Development12页word.docx(5页珍藏版)》请在冰豆网上搜索。
StagesandActivitiesinLanguageTestDevelopment12页word
StagesandActivitiesinLanguageTestDevelopment
Abstract:
Testdevelopmentistheentireprocessofcreatingandusingatest.Theprocessisorganizedintothreestages:
design,operationalization,andadministration.Whiletestdevelopmentisgenerallylinear,withdevelopmentprogressingfromonestagetothenext,theprocessisalsoaniterativeone,inwhichthedecisionsthataremadeandactivitiesthatarecompletedatanystagemayleadustoreconsiderandrevisedecisionsandrepeatactivitiesthathavebeenperformedatanotherstage.Organizingtestdevelopmentinthiswayhelpsusmonitortheusefulnessofthetestthroughoutthedevelopmentprocessandproduceausefultest.
Keywords:
stages,activities,language,test,development
1.Introduction
Testdevelopmentistheentireprocessofcreatingandusingatest,beginningwithitsinitialconceptualizationanddesign,andculminatinginoneormoreachievedtestsandtheresultsoftheiruse.Theamountoftimeandeffortweputintodevelopinglanguagetestswill,ofcourse,varydependinguponthesituation.Atoneextreme,withlow-stakestests,theprocessesmightbequiteinformal,asmightbethecaseifoneteacherwerepreparingashorttesttobeusedasoneofaseriesofweeklyquizzestoassigngrades.Attheotherextreme,withhigh-stakestests,theprocessesmightbehighlycomplex,perhapsinvolvingextensivetrailingandrevision,aswellascoordinatingtheeffortsofalargetestdevelopmentteam.Thismightbenecessaryifatestweretobeusedtomakeimportantdecisionsaffecting,alargenumberofpeople.Wewouldagainpointoutthatalthoughtheamountoftimeandeffortthatgoesintotestdevelopmentmayvary,dependingontheuseforwhichthetestisintended,thequalitiesofusefulnessneedtobecarefullyconsideredandthisconsiderationshouldnotbesacrificedineitherlow-stakesorhigh-stakessituations.
Weorganizetestdevelopmentconceptuallyintothreestages:
design,operationalization,andadministration.Wesay“conceptually”becausethetestdevelopmentprocessisnotstrictlysequentialinitsimplementation.Inpractice,althoughtestdevelopmentisgenerallylinear,withdevelopmentprogressingfromonestagetothenext,theprocessisalsoaniterativeone,inwhichthedecisionsthataremadeandtheactivitiescompletedatonestagemayleadustoreconsiderandrevisedecisions,andrepeatactivities,thathavebeendoneatanotherstage.Whiletherearemanywaystoorganizethetestdevelopmentprocess,wehavediscoveredovertheyearsthatthistypeoforganizationgivesabetterchanceofmonitoringtheusefulnessofthetestthroughoutthedevelopmentprocessandhenceproducingausefultest.
2.Stagesandactivitiesinlanguagetestdevelopment
Stage1:
Design
Inthedesignstagewedescribeindetailthecomponentsofthetestdesignthatwillenableustoinsurethatperformanceonthetesttaskswillcorrespondascloselyaspossibletolanguageuse,andthatthetestscoreswillbemaximallyusefulfortheirintendedpurposes.Designisingeneralalinearprocess,butinsomecasessomeactivitiesareiterative,thatis,willneedtoberepeatedanumberoftimes.Forexample,therearecertainpartsoftheprocess,suchasconsideringqualitiesofusefulnessandresourceallocationandmanagement,thatarerecurrentandwillneedtobeconsideredandthoughtaboutthroughouttheprocess.
Theproductofthedesignstageisadesignstatement,whichisadocumentthatincludesthefollowingcomponents:
1.adescriptionofthepurpose(s)ofthetest,
2.adescriptionoftheTLU(targetlanguageuse)domainandtasktypes,
3.adescriptionofthetesttakersforwhomthetestisintended,
4.adefinitionoftheconstruct(s)tobemeasured,
5.aplanforevaluatingthequalitiesofusefulness,and
6.aninventoryofrequiredandavailableresourcesandaplanfortheirallocationandmanagement.
Thepurposeofthisdocumentistoprovideuswithaprincipledbasisfordevelopingtesttasks,ablueprint,andtests.Itisimportanttopreparethisdocumentcarefully,forthisenablesustomonitorthesubsequentstagesofdevelopment.
Therearesixactivitiesinvolvedinthedesignstage,correspondingtothesixcomponentsofthedesignstatement,asindicatedabove.Thesearedescribedbrieflybelow.
Describingthepurpose(s)ofthetest
Thisactivitymakesexplicitthespecificusesforwhichthetestisintended.Itinvolvesclearlystatingthespecificinferencesaboutlanguageabilityorcapacityforlanguageuseweintendtomakeonthebasisoftestresults,andanyspecificdecisionswhichwillbebasedupontheseinferences.Theresultingstatementofpurposeprovidesabasisforconsideringthepotentialimpactoftestuse.
IdentifyinganddescribingtasksintheTLUdomain
ThisactivitymakesexplicitthetasksintheTLUdomaintowhichwewantourinferencesaboutlanguageabilitytogeneralize,anddescribesTLUtasktypesintermsofdistinctivecharacteristics.ItprovidesasetofdetaileddescriptionsoftheTLUtasktypesthatwillbethebasisfordevelopingactualtesttasks.Thesedescriptionsalsoprovideameansforconsideringthepotentialauthenticityandinteractivenessoftesttasks.
Describingthecharacteristicsofthelanguageusers/testtakers
Thisactivitymakesexplicitthenatureofthepopulationofpotentialtesttakersforwhomthetestisbeingdesigned.Theresultingdescriptionprovidesanotherbasisforconsideringthepotentialimpactoftestuse.
Definingtheconstructtobemeasured
Developingaplanforevaluatingthequalitiesofusefulness
Theplanforevaluatingusefulnessincludesactivitiesthatarepartofeverystageofthetestdevelopmentprocess.Aplanforassessingthequalitiesofusefulnesswillincludeaninitialconsiderationoftheappropriatebalanceamongthesixqualitiesofusefulnessandsettingminimumacceptablelevelsforeach,andachecklistofquestionsthatwewillaskabouteachtesttaskwedevelop.Assessingusefulnessinpretestingandadministeringwillincludecollectingfeedback.Thiswilldealwitharangeofinformation,bothquantitative,suchastestscoresandscoresonindividualtesttasks,andqualitative,suchasobservers’descriptionsandverbalself-reportsfromstudentsonthetesttakingprocess.Finally,theplanwillincludeproceduresforanalyzingtheinformationwehavecollected.Thiswillincludeproceduressuchasthedescriptiveanalysisoftestscores,estimatesofreliability,andappropriateanalysesofthequalitativedata.
Identifyingresourcesanddevelopingaplanfortheirallocationandmanagement
Thisactivitymakesexplicittheresources(human,material,time)thatwillberequiredandthatwillbeavailableforvariousactivitiesduringtestdevelopment,andprovidesaplanforhowtoallocateandmanagethemthroughoutthedevelopmentprocess.Thisactivityfurtherprovidesabasisforconsideringthepotentialpracticallyofthetest,andformonitoringthisthroughoutthetestdevelopmentprocess.
Stage2:
Operationalization
Operationalizationinvolvesdevelopingtesttaskspecificationsforthetypesoftesttaskstobeincludedinthetest,andablueprintthatdescribeshowtesttaskswillbeorganizedtoformactualtests.Operationalizationalsoinvolvesdevelopingandwritingtheactualtesttasks,writinginstructions,andspecifyingtheproceduresforscoringthetest.Byspecifyingtheconditionsunderwhichlanguageusewillbeelicitedandthemethodforscoringresponsestothesetasks,weareprovidingtheoperationaldefinitionoftheconstruct.
Developingtesttasksandablueprint
Indevelopingtesttasks,webeginwiththedescriptionsoftheTLUtasktypesprovidedinthedesignstatement,andmodifythese,againtakingintoconsiderationthequalitiesofusefulness,toproducetesttaskspecifications.Thesecompriseadetaileddescriptionoftherelevanttaskcharacteristics,andprovidethebasisforwritingactualtesttasks.Wewouldnotethattheparticulartaskcharacteristicsthatareincludedandtheorderinwhichtheyarearrangedinthetesttaskspecificationsarelikelytovarysomewhatfromonetestingsituationtoanother.
Ablueprintconsistsofcharacteristicspertainingtothestructure,oroverallorganization,ofthetest,alongwithtesttaskspecificationsforeachtasktypetobeincludedinthetest.Theblueprintdiffersfromthedesignstatementprimarilyintermsofthenarrownessofthefocusandtheamountofdetailincluded.Adesignstatementdescribesthegeneralparametersforthedesignofatest,includingitspurpose,theTLUdomainforwhichitisdesigned,theindividualswhowillbetakingthetest,whatthetestisintendedtomeasure,andsoforth.Ablueprint,ontheotherhand,describeshowactualtesttasksaretobeconstructed,andhowthesetasksaretobearrangedtoformthetest.
Writinginstructions
Writinginstructionsinvolvesdescribingfullyandexplicitlythestructureofthetest,thenatureofthetasksthetesttakerswillbepresented,andhowtheyareexpectedtorespond.Someinstructionsareverygeneralandapplytothetestasawhole.Otherinstructionsarecloselylinkedwithspecifictesttasks.
Specifyingthescoringmethod
Specifyingthescoringmethodinvolvestwosteps:
1.definingthecriteriabywhichthequalityofthetesttakers’responseswillbeevaluatedand
2.determiningtheproceduresthatwillbefollowedtoarriveatascore.
Stage3:
Testadministration
Thetestadministrationstageoftestdevelopmentinvolvesgivingthetestto
- 配套讲稿:
如PPT文件的首页显示word图标,表示该PPT已包含配套word讲稿。双击word图标可打开word文档。
- 特殊限制:
部分文档作品中含有的国旗、国徽等图片,仅作为作品整体效果示例展示,禁止商用。设计者仅对作品中独创性部分享有著作权。
- 关 键 词:
- Stages and Activitiesin Language Test Development12页word Development12 word
链接地址:https://www.bdocx.com/doc/7008703.html