Full-text resources of CEJSH and other databases are now available in the new Library of Science.
Visit https://bibliotekanauki.pl

Results found: 2

first rewind previous Page / 1 next fast forward last

Search results

Search:
in the keywords:  inter-rater reliability
help Sort By:

help Limit search:
first rewind previous Page / 1 next fast forward last
1
Content available remote

The construct of perceived L2 speaking proficiency in a paired testing format

100%
Grubor J.
Poznań Studies in Contemporary Linguistics
|
2013
|
vol. 49
185-203
EN
The main aim of the research was to investigate the construct validity of L2 speaking proficiency in a paired testing format. 100 secondary school students and university students were recruited for the study (m=24, f=76), with a mean age of M=18.67. The par-ticipants were tested in pairs (compare-and-contrast task) by two independent raters on four trait categories: accuracy (A), fluency (F), word choice (WC) and turn taking (TT), on a pre-specified 6-point scale. The inter-rater reliability was computed using two approaches (Pearson’s Product Moment correlation and Cronbach’s alpha), and they both indicated the ratings were reliable. The average scores on the scale and subscales also showed high values of Cronbach’s alpha, which confirmed the reliability of the measurement instruments as well. In order to examine the construct of the participants’ speaking performance, we performed exploratory and confirmatory factor analyses. The final model, with very good fit indices, confirmed the initial hypothesis: the construct of L2 oral proficiency is comprised of all four assumed trait factors; however, the strength of correlations rather suggests that there are two facets of the said construct (linguistic: A, F, WC and sociolinguistic: TT).
2
Content available remote

Shlukování a přepínání v Testu verbální fluence : návrh adaptace kritérií do českého jazyka a shoda posuzovatelů

63%
Víchová M., Dokoupilová M., Chromý J., Urbánek T., Nikolai T.
Československá psychologie (Czechoslovak Psychology)
|
2020
|
vol. 64
|
issue 3
306-320
EN
The main goal of this study was to introduce the evaluation procedure in Verbal fluency task – clustering and switching – to the Czech public, to adapt this procedure to the Czech language and to judge its relevance. The review focuses on the way of arranging the words into the clusters (socalled clustering) and switching between them. This procedure is extended in foreign research but it has not yet been systematically adapted in the Czech context. In the article the theoretical background of clustering and switching in phonological verbal fluency (PVF) and also in semantic verbal fluency (SVF) is introduced and few classifications of clustering are described – e.g. Troyer et al. (1997), Abwender et al. (2001), Libon et al. (2009) and Tallberg et al. (2011). In Study 1, the most cited classification by Troyer et al. (1997) is adapted to the Czech language and the differences between the original version and Czech adaptation are discussed. In Study 2, ten protocols were rated by two raters and the inter-rater reliability was calculated. The value of Cohen,s kappa showed moderate to excellent agreement. This approach is very promising but it requires further research.
CS
Cílem této studie bylo představit české veřejnosti návrh clusteringu a switchingu v testu verbální fluence (VF), adaptovat vybrané klasifikace do českého prostředí a posoudit jejich relevanci. Článek se zabývá hodnocením uspořádání slov do celků (tzv. clusterů) a plynulosti přepínání mezi nimi (switching). Tento v zahraničí rozšířený přístup k analýze protokolů VF nebyl doposud v češtině systematizován. Čtenář je seznámen s teoretickým pozadím hodnocení clusterů a switchů ve fonologické verzi (PVF) i kategoriální verzi (SVF) a některými vybranými klasifikacemi – např. Troyer et al. (1997), Abwender et al. (2001), Libon et al. (2009) či Tallberg et al. (2011). Klasifikace Troyerové et al. (1997), která je celosvětově nejcitovanější, byla převzata a autoři článku se vyjádřili k jednotlivým pravidlům z pohledu českého jazyka i kulturního prostředí (Studie 1). Ve Studii 2 byly u deseti vybraných protokolů dvěma posuzovateli oskórovány fonematické clustery v PVF a sémantické clustery v SVF. Vypočtená shoda posuzovatelů ukázala v obou případech na dobrou až výbornou shodu. Jedná se o velmi slibný, nicméně stále teoretický koncept, jehož aplikace do praxe si žádá další zkoumání.
first rewind previous Page / 1 next fast forward last
JavaScript is turned off in your web browser. Turn it on to take full advantage of this site, then refresh the page.