{smcl} {* *! version 1.1.3 29dec2020}{...} {* findalias asfradohelp}{...} {* vieweralsosee "" "--"}{...} {* vieweralsosee "[R] help" "help help"}{...} {viewerjumpto "Syntax" "holsti##syntax"}{...} {viewerjumpto "Description" "holsti##description"}{...} {viewerjumpto "Options" "holsti##options"}{...} {viewerjumpto "Remarks" "holsti##remarks"}{...} {viewerjumpto "Examples" "holsti##examples"}{...} {viewerjumpto "Stored reults" "holsti##results"}{...} {viewerjumpto "Authors" "holsti##author"}{...} {viewerjumpto "References" "holsti##references"}{...} {title:Title} {phang} {bf:holsti} {hline 2} Calculates the Holsti intercoder reliability coefficient. {marker syntax}{...} {title:Syntax} {p 8 17 2} {cmdab:holsti:} {it:varname} {ifin} [, {it:options}] {p2colreset}{...} {p 4 6 2} {cmd:varname} defines either the variable, for which the Holsti coefficient is computed, or two or more coders, for which intercoder reliability shall be calculated.{p_end} {synoptset 20 tabbed}{...} {synopthdr} {synoptline} {syntab:Main} {synopt:{opt gen:erate(var)}}define a variable containing the number of disagreements per case{p_end} {synoptline} {p2colreset}{...} {p 4 6 2} {cmd:by} is not allowed; see {manhelp by D}.{p_end} {p 4 6 2} {cmd:fweight}s are not allowed; see {help weight}. {marker description}{...} {title:Description} {pstd} {cmd:holsti} calculates the intercoder reliability coefficient for different coders' ratings of one given variable or the intracoder reliability coefficient for one or more coders for one variable at different points in time. Variables can be either integer or string; however, mixing both types will not work. {marker options}{...} {title:Options} {dlgtab:Main} {phang} {opt generate} defines a variable in which the number of disagreements for each analyzed case (given a certain variable or different coders) is stored (useful for diagnostic purposes). {marker remarks}{...} {title:Remarks} {pstd} (1) Disagreements for diagnostic purposes are computed as follows: holsti retrieves the different codings that have been assigned to each case and computes their respective frequency. The prevailing coding for a given case is defined as "correct". Every occurence of a code different from the "correct" code is counted as a disagreement. In case there are equal frequencies for more than one code, holsti defines the first most occuring code as being "correct", the others as disagreeing. {pstd} (2) Please note that the dataset needs to have a certain structure in order for the Holsti-coefficient to be calculated properly. {pstd} Each column in the dataset stands for one single coder and his or her ratings of one given category. The rows define units which are rated concerning the given category. If coders rate different categories, the coders' ratings of the different categories have to be placed in separate columns. {pstd}Let c1, c2, c3 be different coders and stub1, stub2 different categories. The corresponding dataset would be structured as follows: {c TLC}{hline 56}{c TRC} {c |}c1_stub1 c2_stub1 c3_stub1 c1_stub2 c2_stub2 c3_stub2 {c |} {c |}{hline 56}{c |} {c |} 1 1 1 a a a {c |} {c |} 2 2 2 c a c {c |} {c |} 1 1 1 a b a {c |} {c |} 3 2 3 b c c {c |} {c |} 2 2 1 b b b {c |} {c BLC}{hline 56}{c BRC} {marker examples}{...} {title:Examples} {phang}{cmd:. sysuse holstidata}{p_end} {phang}{cmd:. holsti stub1}{p_end} {phang}{cmd:. holsti stub1, gen(dev)}{p_end} {phang}{cmd:. holsti c1_stub1 c3_stub1}{p_end} {marker results}{...} {title:Stored Results} {pstd} {cmd:holsti} stores the following in {cmd:r()}: {synoptset 15 tabbed}{...} {p2col 5 15 19 2: Scalars}{p_end} {synopt:{cmd:r(holsti)}}computed overall Holsti-coefficient{p_end} {synopt:{cmd:r(coder)}}number of coders{p_end} {synopt:{cmd:r(units)}}number of units belonging to one variable (i.e. rownumber in the dataset) {p_end} {p2colreset}{...} {synoptset 15 tabbed}{...} {p2col 5 15 19 2: Macros}{p_end} {synopt:{cmd:r(varcoder)}}name of the variable and/or the coders for which Holsti-coefficients were computed{p_end} {synopt:{cmd:r(varnames)}}list of all variables/coders (i.e. columns in the dataset) that holsti selects using r(varcoder){p_end} {p2colreset}{...} {synoptset 15 tabbed}{...} {p2col 5 15 19 2: Matrices}{p_end} {synopt:{cmd:r(pw_holsti)}}matrix containing pairwise Holsti-coefficients{p_end} {synopt:{cmd:r(denominator)}}matrix containing the number of total codings for each pair of coders{p_end} {synopt:{cmd:r(numerator)}}matrix containing the number of disagreeing codings for each pair of coders{p_end} {p2colreset}{...} {marker author} {title:Authors} {phang}Mona Krewel, Victoria University of Wellington, mona.krewel@vuw.ac.nz{p_end} {phang}Julia Partheymueller, Vienna Center for Electoral Research, julia.partheymueller@univie.ac.at{p_end} {phang}Alexander Staudt, staudtlex@live.de{p_end} {marker references}{...} {title:References} {phang} Holsti, O. R. 1969. {it:Content Analysis for the Social Sciences and Humanities.} Reading, MA: Addison-Wesley.{p_end} {phang} Lombard, M./Snyder-Duch, J./Bracken, C. C. 2002. Content Analysis in Mass Communication: Assessment and Reporting of Intercoder Reliability. {it:Human Communication Research} 28(4): 587-604.