Question 1

Exhibit 9-10: Indicate the type of reliability that would result from the procedures described below.
-Refer to Exhibit 9-10.Direct comparison of item scores by formula.

Accepted Answer

A)   test-retest
B)   alternate form
C)   split-half
D)   Kuder-Richardson

Question 2

High score reliability for a test indicates that

Accepted Answer

A)   the test has validity.
B)   random errors of measurement are not a serious problem.
C)   the test is measuring what it is supposed to be measuring.
D)   the proportion of error variance to true variance is very high.

Question 3

Exhibit 9-1: Choose the type of evidence for validity that is referred to in the following questions.
-Refer to Exhibit 9-1.The test analysis shows that the test is measuring a single trait.

Accepted Answer

A)   evidence based on content
B)   evidence based on internal structure
C)   evidence based on relationship to other variables

Question 4

A researcher has constructed an attitude scale in which each item is scored from 1 to 5 depending on the extent of agreement or disagreement.The estimate of score reliability that would be recommended for this scale is

Accepted Answer

A)   Kuder-Richardson formula 20.
B)   Kuder-Richardson formula 21.
C)   Cronbach's coefficient alpha.
D)   biserial correlation coefficient.
E)   phi coefficient.

Question 5

Which of the following represents the most direct evidence that a test is a valid measure of a construct?

Accepted Answer

A)   The test predicts success in college.
B)   The test scores correlate highly with teachers' ratings.
C)   The test includes a representative sample of the skills taught in the course.
D)   The test of trait Y places individuals into categories that were predicted from the theory of trait Y.

Question 6

The most appropriate reliability index to use for a comprehensive multiple-choice final examination in an introductory college course is

Accepted Answer

A)   Kuder-Richardson 20.
B)   Kuder-Richardson 21.
C)   coefficient of equivalence.
D)   Spearman-Brown.
E)   coefficient of stability.

Question 7

Determine the standard error of measurement for a test with a standard deviation of 15 and a score reliability coefficient of .91.

Accepted Answer

Standard e...

Question 8

Exhibit 9-13: Various types of evidence may be gathered in the process of validating a test.Choose the type of evidence that is illustrated in the examples.
-Refer to Exhibit 9-13.The intercorrelations among the test items.

Accepted Answer

A)   Content
B)   Response processes
C)   Internal structure
D)   Relationship with other variables

Question 9

A test has a score reliability of .70.This means

Accepted Answer

A)   if the test were administered again, at least .70 percent of the subjects would obtain the same score.
B)   the test is 70 percent effective in measuring whatever it does measure.
C)   70 percent of the variance in the observed scores is free of error.
D)   70 percent of the variance in the observed scores is error variance.

Question 10

Miss Jones has constructed a mastery test to give after a unit on fractions.All students must have at least 85 percent of the items correct.Which of the following reliability coefficients would you recommend as being most appropriate for Miss Jones to use?

Accepted Answer

A)   Test-retest
B)   Kuder-Richardson 20
C)   Agreement coefficient
D)   Coefficient alpha

Question 11

Which of the following summarizes the relationship between the standard error measurement and a test's score reliability?

Accepted Answer

A)   The higher the test's reliability, the larger the standard error of measurement.
B)   The higher the test's reliability, the smaller the standard error of measurement.
C)   The standard error of measurement also provides an estimate of the correlation between true scores and error scores.
D)   There is no direct relationship between standard error of measurement and reliability.

Question 12

An insignificant correlation between a mathematics reasoning test and a reading test would be desirable to show that the math test

Accepted Answer

A)   is relatively free from irrelevant variance.
B)   has little validity.
C)   is unreliable.
D)   has the desired reliability.

Question 13

Exhibit 9-13: Various types of evidence may be gathered in the process of validating a test.Choose the type of evidence that is illustrated in the examples.
-Refer to Exhibit 9-13.Subjects may be asked to "think aloud" as they take the test.

Accepted Answer

A)   Content
B)   Response processes
C)   Internal structure
D)   Relationship with other variables

Question 14

Exhibit 9-9: Indicate the type of validity evidence that is represented in the following situations.
-Refer to Exhibit 9-9.Freshman college students who take a German placement test during orientation perform well in the German class in which they are placed by the test.

Accepted Answer

A)   content
B)   construct
C)   concurrent
D)   predictive

Question 15

Exhibit 9-9: Indicate the type of validity evidence that is represented in the following situations.
-Refer to Exhibit 9-9.In validating a teacher-constructed test of writing ability, a researcher correlates the test scores with the grades the students are receiving on their writing exercises in class.

Accepted Answer

A)   content
B)   construct
C)   concurrent
D)   predictive

Question 16

Which of the following score reliability procedures requires that the items all have the same level of difficulty?

Accepted Answer

A)   Kuder-Richardson 20
B)   Kuder-Richardson 21
C)   Split-half
D)   Cronbach alpha

Question 17

In gathering discriminant evidence in a validity study, one determines the correlation between measures of ____ constructs obtained from ____ methods.

Accepted Answer

A)   same, same
B)   same, different
C)   different, same
D)   different, different

Question 18

The major disadvantage of the coefficient of stability and equivalence as a measure of reliability is

Accepted Answer

A)   getting the cooperation of the subjects.
B)   obtaining the two forms of the test.
C)   finding a suitable criterion.
D)   establishing the appropriate time interval.
E)   the statistics involved in calculating the coefficient.

Question 19

Exhibit 9-3: Choose the type of evidence (a-c)  that would be of primary importance for the validity of the following tests.
-Refer to Exhibit 9-3.An employment test for selecting data processors

Accepted Answer

A)   evidence based on content
B)   evidence supporting construct
C)   evidence based on relationship to other variables

Question 20

A researcher has a highly speeded test.The recommended way to estimate the score reliability of this test is to use

Accepted Answer

A)   Cronbach alpha.
B)   Kuder-Richardson 21.
C)   test-retest or equivalent forms.
D)   the split-half procedure.

Exam 9: Validity and Reliability

A test has a score reliability of .70.This means

Correct Answer
verified

Correct Answer
verified

Which of the following represents the most direct evidence that a test is a valid measure of a construct?

Correct Answer
verified

A researcher has constructed an attitude scale in which each item is scored from 1 to 5 depending on the extent of agreement or disagreement.The estimate of score reliability that would be recommended for this scale is

Correct Answer
verified

Miss Jones has constructed a mastery test to give after a unit on fractions.All students must have at least 85 percent of the items correct.Which of the following reliability coefficients would you recommend as being most appropriate for Miss Jones to use?

Correct Answer
verified

Exhibit 9-10: Indicate the type of reliability that would result from the procedures described below. -Refer to Exhibit 9-10.Direct comparison of item scores by formula.

Correct Answer
verified

An insignificant correlation between a mathematics reasoning test and a reading test would be desirable to show that the math test

Correct Answer
verified

The most appropriate reliability index to use for a comprehensive multiple-choice final examination in an introductory college course is

Correct Answer
verified

Determine the standard error of measurement for a test with a standard deviation of 15 and a score reliability coefficient of .91.

Correct Answer
verified
Standard e...
View Answer

Which of the following score reliability procedures requires that the items all have the same level of difficulty?

Correct Answer
verified

Exhibit 9-3: Choose the type of evidence (a-c) that would be of primary importance for the validity of the following tests. -Refer to Exhibit 9-3.An employment test for selecting data processors

Correct Answer
verified

Exhibit 9-1: Choose the type of evidence for validity that is referred to in the following questions. -Refer to Exhibit 9-1.The test analysis shows that the test is measuring a single trait.

Correct Answer
verified

A researcher has a highly speeded test.The recommended way to estimate the score reliability of this test is to use

Correct Answer
verified

Exhibit 9-13: Various types of evidence may be gathered in the process of validating a test.Choose the type of evidence that is illustrated in the examples. -Refer to Exhibit 9-13.The intercorrelations among the test items.

Correct Answer
verified

High score reliability for a test indicates that

Correct Answer
verified

The major disadvantage of the coefficient of stability and equivalence as a measure of reliability is

Correct Answer
verified

Exhibit 9-9: Indicate the type of validity evidence that is represented in the following situations. -Refer to Exhibit 9-9.Freshman college students who take a German placement test during orientation perform well in the German class in which they are placed by the test.

Correct Answer
verified

Exhibit 9-13: Various types of evidence may be gathered in the process of validating a test.Choose the type of evidence that is illustrated in the examples. -Refer to Exhibit 9-13.Subjects may be asked to "think aloud" as they take the test.

Correct Answer
verified

Which of the following summarizes the relationship between the standard error measurement and a test's score reliability?

Correct Answer
verified

In gathering discriminant evidence in a validity study, one determines the correlation between measures of constructs obtained from methods.

Correct Answer
verified

Exam 9: Validity and Reliability

A test has a score reliability of .70.This means

Correct AnswerverifiedShow Answer

Correct AnswerverifiedShow Answer

Which of the following represents the most direct evidence that a test is a valid measure of a construct?

Correct AnswerverifiedShow Answer

A researcher has constructed an attitude scale in which each item is scored from 1 to 5 depending on the extent of agreement or disagreement.The estimate of score reliability that would be recommended for this scale is

Correct AnswerverifiedShow Answer

Miss Jones has constructed a mastery test to give after a unit on fractions.All students must have at least 85 percent of the items correct.Which of the following reliability coefficients would you recommend as being most appropriate for Miss Jones to use?

Correct AnswerverifiedShow Answer

Exhibit 9-10: Indicate the type of reliability that would result from the procedures described below. -Refer to Exhibit 9-10.Direct comparison of item scores by formula.

Correct AnswerverifiedShow Answer

An insignificant correlation between a mathematics reasoning test and a reading test would be desirable to show that the math test

Correct AnswerverifiedShow Answer

The most appropriate reliability index to use for a comprehensive multiple-choice final examination in an introductory college course is

Correct AnswerverifiedShow Answer

Determine the standard error of measurement for a test with a standard deviation of 15 and a score reliability coefficient of .91.

Correct AnswerverifiedStandard e...View AnswerShow Answer

Which of the following score reliability procedures requires that the items all have the same level of difficulty?

Correct AnswerverifiedShow Answer

Exhibit 9-3: Choose the type of evidence (a-c) that would be of primary importance for the validity of the following tests. -Refer to Exhibit 9-3.An employment test for selecting data processors

Correct AnswerverifiedShow Answer

Exhibit 9-1: Choose the type of evidence for validity that is referred to in the following questions. -Refer to Exhibit 9-1.The test analysis shows that the test is measuring a single trait.

Correct AnswerverifiedShow Answer

A researcher has a highly speeded test.The recommended way to estimate the score reliability of this test is to use

Correct AnswerverifiedShow Answer

Exhibit 9-13: Various types of evidence may be gathered in the process of validating a test.Choose the type of evidence that is illustrated in the examples. -Refer to Exhibit 9-13.The intercorrelations among the test items.

Correct AnswerverifiedShow Answer

High score reliability for a test indicates that

Correct AnswerverifiedShow Answer

The major disadvantage of the coefficient of stability and equivalence as a measure of reliability is

Correct AnswerverifiedShow Answer

Exhibit 9-9: Indicate the type of validity evidence that is represented in the following situations. -Refer to Exhibit 9-9.Freshman college students who take a German placement test during orientation perform well in the German class in which they are placed by the test.

Correct AnswerverifiedShow Answer

Exhibit 9-13: Various types of evidence may be gathered in the process of validating a test.Choose the type of evidence that is illustrated in the examples. -Refer to Exhibit 9-13.Subjects may be asked to "think aloud" as they take the test.

Correct AnswerverifiedShow Answer

Which of the following summarizes the relationship between the standard error measurement and a test's score reliability?

Correct AnswerverifiedShow Answer

In gathering discriminant evidence in a validity study, one determines the correlation between measures of ____ constructs obtained from ____ methods.

Correct AnswerverifiedShow Answer

Correct Answer
verified

Correct Answer
verified

Correct Answer
verified

Correct Answer
verified

Correct Answer
verified

Correct Answer
verified

Correct Answer
verified

Correct Answer
verified

Correct Answer
verified
Standard e...
View Answer

Correct Answer
verified

Correct Answer
verified

Correct Answer
verified

Correct Answer
verified

Correct Answer
verified

Correct Answer
verified

Correct Answer
verified

Correct Answer
verified

Correct Answer
verified

Correct Answer
verified

In gathering discriminant evidence in a validity study, one determines the correlation between measures of constructs obtained from methods.

Correct Answer
verified