Publication Type
Journal Article
Version
publishedVersion
Publication Date
10-2018
Abstract
The quality of cross-language scale translations is often explored by having bilingual participants complete the scale in both languages and then correlating their scores. However, low cross-language correlations can be observed due to score unreliability rather than due to poor scale translation. McCrae, Yik, Trapnell, Bond, and Paulhus suggested that a better indicator of translation quality can be formed by dividing the raw cross-language correlation by the same-language retest correlations over a similar measurement interval. Here, we illustrate how this method can be extended to evaluate the translation quality of individual items. We translated the English version of the Inventory of Individual Differences in the Lexicon (IIDL) into Chinese, and within a single survey session participants either completed the instrument either in both languages (N = 151 bilingual participants) or twice in Chinese (N = 94) or in English (N = 82). Finally, additional bilingual participants (N = 46) rated the perceived translation quality of each item. Variation in the cross-language correlations across items predicted perceived translation quality, however, adjusting for same-language retest correlations resulted in significantly stronger indicators of perceived translation quality. The present study thus indicates the validity of McCrae et al.’s general method, and demonstrates that it can be extended to designs where all participants complete a single test session and can be applied to evaluate the quality of translations of single items.
Keywords
scale translation, translation quality, scale reliability, bilingual, within-session retest
Discipline
Multicultural Psychology | Social Psychology
Research Areas
Psychology
Publication
Journal of Cross-Cultural Psychology
Volume
49
Issue
9
First Page
1325
Last Page
1339
ISSN
0022-0221
Identifier
10.1177/0022022118789773
Publisher
SAGE Publications (UK and US)
Citation
WOOD, Dustin, QIU, Lin, LU, Jiahui, LIN, Han, & TOV, William.(2018). Adjusting Bilingual Ratings by Retest Reliability Improves Estimation of Translation Quality. Journal of Cross-Cultural Psychology, 49(9), 1325-1339.
Available at: https://ink.library.smu.edu.sg/soss_research/3845
Copyright Owner and License
Authors
Creative Commons License
This work is licensed under a Creative Commons Attribution-NonCommercial-No Derivative Works 4.0 International License.
Additional URL
https://doi.org/10.1177/0022022118789773